The{Geek}Diary

HowTos|Concepts|Guides

SOLARIS

SOLARIS11

ZONES

LDOMS

VCS

LINUX

INTERVIEWQUESTIONS

ORACLE

TheUltimateLDOMstroubleshootingguide
BySandeep 2Comments

MostoftheLDOMissuescanbeeasilyresolvedbylookingattheerrormessage.Belowaresomeofthe
mostcommonlyfacedLDOMissuesandbasictroubleshootingtipstoresolvethem.
1.UnabletocreateLDom
2.UnabletoinstallLDom
3.UnabletoconfigureLDom
4.UnabletobindLDom
5.UnabletoconnecttoLDom

HowtoverifyifLDomservicesarestarted
BelowaretwobasicservicesneedstoberunningonthePrimarydomain(akaControldomain)forthe
ldomtostart/workproperly.

1.svc:/ldoms/ldmd:default
2.svc:/ldoms/vntsd:default

Here,ldmdisldomserviceandvntsdisthevirtualconsoleservice.Thestateoftheserviceshouldbe
online,ratherthandisabled/maintenance.IftheStateoftheserviceisdisabledwecantryrestartingit

online,ratherthandisabled/maintenance.IftheStateoftheserviceisdisabledwecantryrestartingit
usingsvcadmcommand.Ifthestateoftheserviceisinmaintenancecheckthebelowlogsforany
abnormalities:
/var/svc/log/ldomsldmd:default.logfortheldmlogs
/var/svc/log/ldomsvntsd:default.logforthevntsdlogs
Alsocheck/var/adm/messagesfileforanyerrorlogsrelatedtoLDOMs.Usethepscommandtocheckthe
processlistwhethertheldmdandvntsdisthereintheprocesslistornot.
#psef|egrep"vntsd|ldmd"

Belowisthedefaultconfigurationoftheldmdserviceandthevntsdservice:
svc:>selectldoms/ldmd
svc:/ldoms/ldmd>listprop
ldmdapplication
ldmd/debuginteger0
ldmd/hopsinteger0
ldmd/nocfgbooleanfalse
ldmd/xmppbooleanfalse
fmd_configapplication
fmd_config/fmd_to_ldmd_init_timeoutinteger20
fmd_config/fmd_to_ldmd_running_timeoutinteger10
filesystemdependency
filesystem/entitiesfmrisvc:/system/filesystem/local
filesystem/groupingastringrequire_all
filesystem/restart_onastringnone
filesystem/typeastringservice
generalframework
general/action_authorizationastringsolaris.smf.manage.ldoms
general/entity_stabilityastringUnstable
general/single_instancebooleantrue
startmethod
start/execastring/opt/SUNWldm/bin/ldmd_start
start/timeout_secondscount120
start/typeastringmethod
stopmethod
stop/execastring:kill
stop/timeout_secondscount60
stop/typeastringmethod
tm_common_nametemplate
tm_common_name/Custring"LogicalDomainManager"

svc:>selectldoms/vntsd
svc:/ldoms/vntsd>listprop
vntsdapplication
vntsd/listen_addrastringlocalhost
vntsd/timeout_minutesinteger0
vntsd/vcc_deviceastringvirtualconsoleconcentrator@0
networkdependency
network/entitiesfmrisvc:/milestone/network
network/groupingastringoptional_all
network/restart_onastringerror
network/typeastringservice
syslogdependency
syslog/entitiesfmrisvc:/system/systemlog
syslog/groupingastringoptional_all

syslog/restart_onastringnone
syslog/typeastringservice
generalframework
general/entity_stabilityastringUnstable
startmethod
start/execastring/lib/svc/method/svcvntsd
start/timeout_seco

Ifunabletotelnettoaguestldomfromcontroldomain,onemayneedtostop/restartvntsdservice:
#svcadmdisable/ldoms/vntsd
#svcadmenable/ldoms/vntsd

OVMforSPARC(LDOMs):Troubleshootingconsoleissues

LDOMconsolelogs
StartingfromLDom3.0,consolelogiscollectedat/var/log/vntsd/*/*(minimumSolaris11onprimary
domain).
#ldmlist
NAMESTATEFLAGSCONSVCPUMEMORYUTILNORMUPTIME
primaryactivencvUART824G0.2%0.2%12d11h1m
ldom01activen4001102304M0.1%0.1%12d7h22m
//consolelogsonlivesystem:
#lsl/var/log/vntsd/*/*
rw1rootroot2812386Sep1810:38/var/log/vntsd/ldom01/consolelog

Ensureproperbindingofresources
InorderforresourcestobeassignedtotheLDOMdomains,theyneedtobeboundtotheappropriate
domain.Thisprocessbindsthevirtualresourcestoactualphysicalresourcesavailableonthesystem.If
thereisnotenoughphysicalresourcetobeallocated,failurewillbereportedduringthebindingprocess.
Oneormoreofthefollowingerrorsareobservedwhenonehaveissuebindingresources:
1.InsufficientVCPUSresourcestobindLDom.
2.Notenoughfreememorypresenttomeetthisrequest.
3.CouldnotbindrequestedmemoryforLDom.
4.Only[number]physicalcryptounitresource(s)availabletobindtoLDom.
5.Didntfindasuitablevccserviceinaboundservicedomaintobindguest[guestname]console.
BelowisanewlycreatedLDomguestnamedguest01,withresourcesadded,butnotbeingboundyet.
NoticethattheLDCfieldsareblank,andtherearenoactualallocationofVCPUsandmemory.The
STATEoftheguestisnotedasinactive.
#ldmlistbindingseguest01
NAMESTATEFLAGSCONSVCPUMEMORYUTILUPTIME
guest01inactive43G
UUID
1105fe75b5c66447929ca8dba81db847

1105fe75b5c66447929ca8dba81db847
MAC
00:14:4f:fa:2e:70
CONTROL
failurepolicy=ignore
extendedmapinspace=off
cpuarch=native
rcaddpolicy=
shutdowngroup=15
DEPENDENCY
master=
CONSTRAINT
threading=maxthroughput
VARIABLES
autoboot?=false
bootdevice=/virtualdevices@100/channeldevices@200/disk@0:adisknet
pm_boot_policy=disabled=1;ttfc=0;ttmr=0;
NETWORK

NAMESERVICEIDDEVICEMACMODEPVIDVIDMTUMAXBW

vnet0primaryvsw0000:14:4f:fb:c2:d01

vnet1sec1vsw0100:14:4f:fa:95:921
DISK
NAMEVOLUMETOUTIDDEVICESERVERMPGROUP
guest01rootguest01root@primaryvds00
guest01data1guest01data1@primaryvds01
VLDCC
NAMESERVICEDESCLDC
dsprimaryvldc0@primarydomainservices

Oncetheguestisbound,theactualphysicalresourcesarebound,andLDCs(LogicalDomainChannels)
areassigned.ThedomainSTATEwillbeshownasbound.
Memorybindingfailures
Memorybindingfailureisreportedwhenthereisnoadditionalunallocatedmemoryavailableforallocation.
ldmbindwillreportthefollowingerror:
#ldmbindguest01
NotenoughfreememorypresenttomeetthisrequestCouldnotbindrequestedmemoryforLDomguest01

Correctiveactions:
1.Reviewhowmuchunallocatedmemoryisavailableonthesystemusingtheldmlistdevicesmemory
subcommand.Thenassigntheactualfreeavailablememorytothedomain.
#ldmlistdevicesmemory
MEMORY
PASIZE
0x1880000001920M
#ldmsetmemory1920Mguest01
#ldmbindguest01

#ldmbindguest01

2.Alternatively,reducetheamountofmemoryfromanotherdomainbyusingtheldmsetmemoryor
removememorysubcommandontheanotherdomain.Thenproceedtobindthedomain.
#ldmremovememory1gprimary
#ldmbindguest01

VCPUbindingfailure
VCPUbindingfailureisreportedwhenthereisnoadditionalunallocatedVCPUavailableforallocation.
ldmbindwillreportthefollowingerror:
#ldmbindguest01
InsufficientVCPUresourcestobindLDomguest01

Thecorrectiveactionsareto:
1.ReviewhowmanyunallocatedVCPUsareavailableonthesystemusingtheldmlistdevicesvcpu
subcommand.ThenassignedtheactualfreeavailableVCPUstothedomain.
#ldmlistdevicesvcpu
VCPU
PID%FREE
28100
29100
30100
31100
#ldmsetvcpu4guest01
#ldmbindguest01

2.Alternatively,reducetheamountofVCPUsfromanotherdomainbyusingtheldm(1M)setvcpuor
removevcpusubcommandontheanotherdomain.Thenproceedtobindthedomain.
#ldmremovevcpu2primary
#ldmbindguest01

MAU(CryptographicUnit)bindingfailure
*NOTE*MAUunitsareonT1,T2andT3seriessystemsonly.T4systemsdonothaveMAUs.OnT4
systems,eachcorecontainsastreamprocessingunit(SPU)thatprovidescryptographicprocessing.
MAUbindingfailureisreportedwhenthereisnoadditionalunallocatedMAUavailableforallocation.
AdditionallyrequirementisthatatleastoneoftheVCPUsfromtheprocessorcorewheretheMAU
originatedhastobeassignedtothedomain.DespitetheMAUbindingfailure,thebindwillproceedwith
therestofresources.ldmbindwillreportthefollowingerror:
#ldmbindguest01
Only1physicalcryptounitresource(s)availabletobindtoLDomguest01,proceedingwithbinding1additionalcryptounit(s)

Thecorrectiveactionsareto:
1.ReviewhowmanyunallocatedMAUsareavailableonthesystemusingtheldmlistdevicesmau
subcommand.ThenmakesureatleastoneVCPUsfromtheassociatedcoreisassigneddomainbefore

subcommand.ThenmakesureatleastoneVCPUsfromtheassociatedcoreisassigneddomainbefore
assigningtheavailableMAUstothedomain.
#ldmlistdevicesmau
MAU
IDCPUSET
2(8,9,10,11)
3(12,13,14,15)
4(16,17,18,19)
5(20,21,22,23)
6(24,25,26,27)
7(28,29,30,31)
#ldmaddvcpu1guest01
#ldmaddmau1guest01
#ldmbindguest01

2.Alternatively,reducetheamountofMAUsfromanotherdomainbyusingtheldmsetmauorremove
mausubcommandontheanotherdomain.Here,againonemusttakecaretoensureoneVCPUfromthe
corewheretheMAUisoriginatingfromisassignedtothedomain.Thenproceedtobindthedomain.
#ldmremovemau1primary

Onemayalsoneedtoremove1VCPUandassigntotheguesttomakesureoneoftheVCPUsfromthe
samecoreastheMAUisassignedtotheguest.
#ldmremovevcpu1primary
#ldmaddvcpu1primary
#ldmbindguest01

VirtualConsolebindingfailure
Virtualconsoleconcentrator(VCC)andvirtualconsole(VCONS)provideconsoleaccesstotheguest
domain.Itneedtobeboundavirtualconsoleservicecreatedontheprimarydomain.MiscoveredVCC
canresultedinerrorduringbinding:
#ldmbindguest01

Thevirtualconsoleconcentratorserviceprimaryvcc1notexistorisnotbound.Didn'tfindasuitablevccserviceinaboundservic

ToensuretheVCCconfigurationsareconfiguredaccording,usetheldmlistlcomandtoreviewthe
configurations:
#ldmlistlguest01
NAMESTATEFLAGSCONSVCPUMEMORYUTILUPTIME
guest01bound500143G
linesomitted
VCONS
NAMESERVICEPORTLOGGING
guest01primaryvcc0@primary5001on

#ldmlistlprimary
NAMESTATEFLAGSCONSVCPUMEMORYUTILUPTIME
primaryactivencvSP44128M0.9%14d55m

primaryactivencvSP44128M0.9%14d55m
linesomitted
VCC
NAMEPORTRANGE
primaryvcc050005100
linesomitted
VCONS
NAMESERVICEPORTLOGGING
SP

Ifnotconfigured,pleasefollowthefollowingstepstoconfiguretheconsoleservice:
#ldmaddvconsconportrange=50005100primaryvcc0primary
#ldmsetvconsoleport=5000service=primaryvcc0@primaryguest01

ThenmakesurethattheLDomconsoleSMFserviceisupdateandrunning:
#svcsvntsd
STATESTIMEFMRI
offline13:20:40svc:/ldoms/vntsd:default
#svcadmenablevntsd
#svcsvntsd
STATESTIMEFMRI
online13:39:35svc:/ldoms/vntsd:default

Datacollectionfortroubleshooting
Itisimportanttoprovidethepropertroubleshootingdatatooraclesupportinordertogetaspeedy
resolution.BelowarefewlogfileswhichcanbereallyhelpfulintroubleshootingtheLDOMissues.
SMF(ServiceManagementFacility)logsfortheLDomrelatedservicesontheprimarydomain
/var/svc/log/ldomsldmd:default.log
/var/svc/log/ldomsvntsd:default.log
/var/svc/log/ldomsagents:default.log
/var/opt/SUNWldm/ldomdb.xml

SMF(ServiceManagementFacility)andlogsfortheLDomrelatedservicesontheGuestLDom
/var/svc/log/platformsun4vdrd:default.log
/var/svc/log/ldomsagents:default.log

Iftheldmddaemondumpscore,thecorefilewillbe/var/opt/SUNWldm/coreunlessyouhaveused
coreadmtocontrolthecorefilelocation.ThemessageInvalidresponsefromldmusuallymeansthat
theldmddaemonhasdumpedcoresothecorefileshouldbecollectedinthatcase.
explorer
ExplorercollectsanumberofimportantLDomrelatedoutputsonprimary(control)domain:
#/opt/SUNWexplo/bin/explorerwdefault,ldom

SHAREON

SHAREON
Twitter

Facebook

Google+

FiledUnder:LDOMs
TaggedWith:ldom,ldomtroubleshooting

RelatedPosts
HowtoresetLDOMconfigurationtofactorydefault
HowtoinstallandconfigureLDOMs(OracleVMforSPARC)
HowtosaveLDOMconfigurationandrestorefromxmlfile
HowtocloneLDOMsusingZFS
OVMforSPARC(LDOMs):Troubleshootingconsoleissues

LOADCOMMENTS

Searchtheblog...

SandeepPatil
IndiabasedUnixAdmin,Cloud
EvangelistandaVirtualization
lover.Readmoreaboutmehere...

GETYOURFREEE
BOOK
DownloadtheFREEebookThe
CompleteOracleHardware
reference

Enteryouremail

SUBSCRIBE

ARCHIVES

CONT ACT US

COPYRIGHT