LDom guest domains hang in "OpenBoot initializing" after installing SysFW 8.4.1 or later

Asset ID:	1-72-1914142.1
Update Date:	2017-10-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1914142.1 : LDom guest domains hang in "OpenBoot initializing" after installing SysFW 8.4.1 or later

Applies to:

Solaris SPARC Operating System - Version 10 8/11 U10 and later
SPARC T4-4 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

Following an upgrade to SysFW 8.4.1 or later on Solaris 10 based systems running Oracle VM 2.x or 3.x, guest domains assigned dedicated I/O (such as Standard Direct I/O) may hang during OpenBoot initialization following a power cycle.

# ldm ls

NAME STATE FLAGS CONS VCPU MEMORY UTIL NORM UPTIME
primary active -n-cv- UART 16 27904M 5.1% 5.1% 10m
domain1 active -t---- 5000 8 30G 12% 12% 10m
domain2 active -t---- 5001 16 19G 6.2% 6.2% 10m
domain3 active -t---- 5002 8 30G 12% 12% 10m
domain4 active -t---- 5003 16 30G 6.3% 6.3% 10m
domain5 active -t---- 5004 16 30G 6.2% 6.2% 10m
domain6 active -t---- 5005 16 90G 6.2% 6.2% 10m
domain7 active -t---- 5006 8 30G 12% 12% 10m
domain8 active -t---- 5007 2 1G 50% 50% 10m
domain9 active -t---- 5008 8 15G 12% 12% 10m
# ldm ls -l | grep OpenBoot
OpenBoot initializing <<
OpenBoot initializing <<
OpenBoot initializing <<
OpenBoot Running
OpenBoot Running
OpenBoot Running
OpenBoot Running
OpenBoot initializing <<
OpenBoot initializing <<
#

Use 'ldm list-io' to confirm whether the impacted domains are assigned I/O

Cause

I/O devices are not mapped by Hypervisor before being marked as ready causing the guest domain to loop during initialisation with Oracle VM2.x and Oracle VM3.x and SysFW 8.4.1 and later - this behavior was introduced with changes implemented in the following bug;

BUG : 17655884 / 19169677

Solution

Install the following patches on the primary/control domain for systems running Oracle VM 2.x or 3.x;

146582-03 fmadm patch
148322-08 ixgbe patch
148324-07 ixgbevf patch
148888-05 kernel patch
150107-01 ds patch
150400-02 kernel patch
150840-02 platsvc patch

References

<BUG:19169677> - LDOM GUEST HANGS IN "OPENBOOT INITIALIZING" AFTER POWER CYCLE
<NOTE:1392395.1> - How to force a crash dump on SPARC T5xx0/T3-x/T4-x/T5-x(with iLOM shell)
<NOTE:1004608.1> - How to Collect a Live Solaris Kernel Dump
<BUG:17655884> - ATU SETUP FOR A DEVICE SHOULD BE FINISHED WHEN IT IS MARKED IOV_READY
<BUG:19169677> - LDOM GUEST HANGS IN "OPENBOOT INITIALIZING" AFTER POWER CYCLE

Attachments

This solution has no attachment