Exadata: 12c Cloud Control Alert From InfiniBand (IB) Switch On Port 36

Asset ID:	1-72-1552977.1
Update Date:	2013-06-17
Keywords:

Solution Type Problem Resolution Sure

Solution 1552977.1 : Exadata: 12c Cloud Control Alert From InfiniBand (IB) Switch On Port 36

Applies to:

Exadata Database Machine X2-2 Hardware - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

An alert is received from EM 12c Cloud Control console:

Target db01sw-ib3.xxxxxxx.com(Oracle Infiniband Switch)
Incident Created Apr 17, 2013 12:47:01 PM EDT
Last Updated May 7, 2013 8:16:30 PM EDT
Summary Cable is present on Port 36 but it is polling for peer port. This could happen when the cable is unplugged from one of the ends or the other end port is disabled.

Cause

This is due to Internal/Unpublished Bug 13645783 - CONNECTIVITY INFO FOR PORT 36 ON IB SWITCH IS IGNORED

REDISCOVERY INFORMATION: Port 36 is shown available even though it is connected.

Solution

Verify the IB Switch with the following commands from MOS note Gathering Troubleshooting Information for the Infiniband Network in Exadata/Exalogic Engineered Systems [Doc ID 1538237.1] :

1. The listlinkup from the IB Switch shows that link is not up for port 36. Therefore, it is not connected at all.

[root@db01sw-ib3 ~]# listlinkup

Connector 0A Not present
Connector 1A Not present

...

Connector 5B Present <-> Switch Port 29 is up (Enabled)
Connector 6B Present <-> Switch Port 36 is down (Enabled)

...

2. Run verify-topology command from the DB node - it should return SUCCESS:

[root@db01db02]# /opt/oracle.SupportTools/ibdiagtools/verify-topology -t quarterrack

[ DB Machine Infiniband Cabling Topology Verification Tool ]
[Version IBD VER 2.c ]
External non-Exadata-image nodes found...Ignoring those

--------------- Quarter Rack Exadata V2 Cabling Check---------

Check if all hosts have 2 CAs to different switches..................[SUCCESS]
Leaf switch check: cardinality and even distribution.................[SUCCESS]
Check if each rack has an valid internal ring........................[SUCCESS]

3. The ibnetdiscover command does not list port 36, that is not used in Exadata

db01db02# ibnetdiscover

As long as your results are the same, you may ignore this alert. This bug is fixed in 12.1.0.3 version of the Exadata Plugin.

References

<NOTE:1538237.1> - Gathering Troubleshooting Information for the Infiniband Network in Exadata/Exalogic Engineered Systems
<BUG:13645783> - CONNECTIVITY INFO FOR PORT 36 ON IB SWITCH IS IGNORED

Attachments

This solution has no attachment