Oracle Fabric Interconnect F1-15
 
Oracle Fabric Interconnect F1-4
 

PLA-Support>Sun Systems>SAND>Network>SN-SND: Oracle Virtual Networking
 

In this Document

Symptoms

Cause

Solution

References

Created from <SR 3-11230367361>

Applies to:

Symptoms

XMS is showing IO Link is down for one of the 10G Ethernet cards. ESX hosts alarms report one of the two redundant vnics has dropped.

Cause

OpenSM dropped port for IO Card 1:
Aug 20 13:19:36 298154 [B661AB90] 0x02 -> drop_mgr_remove_port: Removed port with GUID:0x0013970301001bfc LID range [5, 5] of node:Xsigo Systems, xsigo2 slot=1 vn10gcard

OpenSM notes IO Card 1 port is back up after resetting the IO Card:
Aug 20 15:05:57 458195 [B661AB90] 0x02 -> state_mgr_report_new_ports: Discovered new port with GUID:0x0013970301001bfc LID range [5,5] of node: Xsigo Systems, xsigo2 slot=1 vn10gcard

Here is time stamp of when manually set this IO Card down - notice it correlates to the time stamp of when OpenSM reported it discovered this new port:

Aug 20 14:59:19 fpp chassisCtr[469]: [NOTICE] chassisctr fpp-1 [chassis::iocardadminstatechange] [IOCARD=1] (changeAdminState) New AdminState=adminStateDown, OperState=operStateUp, Qualifier=default
Aug 20 14:59:19 fpp chassisCtr[469]: [ALERT] chassisctr fpp-1 [chassis::iocardoff] [IOCARD=1] Powered off.
Aug 20 14:59:19 fpp chassisCtr[469]: [NOTICE] chassisctr fpp-1 [chassis::cardstatechange] (reportState) [IOCARD=1] Operational state changed. OldState=operStateUp, NewState=operStateDown, Qualifier=default
Aug 20 14:59:19 fpp chassisCtr[469]: [NOTICE] chassisctr fpp-1 [IOCARD=1] Power Down

In this case the cause of this is due to the bug noted below.  The fix checked into 4.x XgOS is to *reset* the card whenever ibport logical state is !=ACTIVE and the ibport logical state is down by OpenSM. The OpenSM logs do note it removed this port on Aug 20 @ 13:19:36 which is the signature of this bug

The fix for this issue is in 4.x XgOS.

16336525 XT/XT2 Driver Reset the Card Whenever ibport logical state != ACTIVE and the ibport logical state Is Down By opensm.
 
OpenSM dropped port for IO Card 1:
Aug 20 13:19:36 298154 [B661AB90] 0x02 -> drop_mgr_remove_port: Removed port with GUID:0x0013970301001bfc LID range [5, 5] of node:Xsigo Systems, xsigo2 slot=1 vn10gcard
 

Solution

Upgrade to 4.0.4 XgOS which is current GA XgOS. Bug fix was initially released in 4.0.0 XgOS and subsequently all following 4.x XgOS releases including 4.0.4 XgOS.

16336525 XT/XT2 Driver Reset the Card Whenever ibport logical state != ACTIVE and the ibport logical state Is Down By opensm.
 

References

This solution has no attachment