Asset ID:	1-72-1275503.1
Update Date:	2015-01-22
Keywords:

---

Solution Type  Problem Resolution Sure

Solution  1275503.1 :   Verify-Topology may Report Errors  

In this Document

Symptoms

Cause

Solution

---

Created from <SR 3-2578138031>

Applies to:

Oracle Exadata Hardware - Version 11.2.0.2 and later
Exadata Database Machine X2-8
Information in this document applies to any platform.

Symptoms

verify-topology could fail with errors like:

opt/oracle.SupportTools/ibdiagtools/verify-topology -t fattree

[ DB Machine Infiniband Cabling Topology Verification Tool ]
[Version 11.2.1.3.b]
External non-Exadata-image nodes found...Ignoring those

Looking at 1 rack(s).....
Spine switch check: Are any Exadata nodes connected ..............[SUCCESS]
Spine switch check: Any inter spine switch connections............[SUCCESS]
Spine switch check: Correct number of spine-leaf links............[SUCCESS]
Leaf switch check: Inter-leaf link check..........................[SUCCESS]
Leaf switch check: Correct number of leaf-spine connections.......[SUCCESS]
Check if all hosts have 2 CAs to different switches...............[SUCCESS]
Leaf switch check: cardinality and even distribution..............[ERROR]

Leaf Switch aex1sw-ib2.ppdi.com with GUID 0x2128469ea8a0a0 has fewer than 4 compute nodes connections
It has 0 links ( ) to compute nodes
[ERROR]

Leaf Switch aex1sw-ib3.ppdi.com with GUID 0x2128469e0ba0a0 has fewer than 4 compute nodes connections
It has 0 links ( ) to compute nodes
[SUCCESS]

Or

Leaf switch check: cardinality and even distribution..............[ERROR]

Leaf Switch aex1sw-ib2.ppdi.com with GUID 0x2128469ea8a0a0has fewer than 8 connections to compute nodes
It has 7 links (14A 13A 13B 12B 4B 4A 5A) to compute nodes
[ERROR]

Leaf Switch aex1sw-ib3.ppdi.com with GUID 0x2128469e0ba0a0has fewer than 8 connections to compute nodes
It has 7 links (4B 4A 5A 14A 13A 13B 12B) to compute nodes
[ERROR]
2 switches did not meet this requirement

Cause

Compute nodes (database nodes) could not  have the proper description information

ibnetdiscover data should show compute nodes are missing the node type and IP address. For example:


[25] "H-00212800013ecffa"[2](212800013ecffc) # "aex1db08 HCA-1" lid 45 4xQDR

It should look like

[28] "H-00212800013ecf7e"[2](212800013ecf80) # "aex1db07 S 192.168.10.7 HCA-1" lid 33 4xQDR

aex1db08 is missing the S and IP address.

Solution

Execute /opt/oracle.cellos/ib_set_node_desc.sh on all the compute nodes. This should set the node description with the correct data.

Attachments

This solution has no attachment