| Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback |
| Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition | ||
|
|
||
 |
||||||||||||||||
Solution Type Problem Resolution Sure Solution 1664640.1 : Running networksetup-two script for new installation on Oracle Big Data Appliance (BDA) X4-2 fails with "gwp2js:no ports found for leaf1"
In this Document
Applies to:Big Data Appliance X4-2 Hardware - Version All Versions and laterLinux x86-64 Symptoms While running networksetup-two script for new installation on Oracle Big Data Appliance (BDA) X4-2, the following errors are seen: [root@bda1node01 network]# ./networksetup-two | tee /tmp/network-conf.out
networksetup-two: analyse /opt/oracle/bda/BdaDeploy.json networksetup-two: passed networksetup-two: checking for BdaExpansion.json networksetup-two: ping server ips on admin network networksetup-two: passed networksetup-two: test ssh server ips on admin network networksetup-two: passed networksetup-two: run connected network post script on each server networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for this node networksetup-two: ping servers by name on admin network networksetup-two: passed networksetup-two: verify infiniband topology networksetup-two: passed networksetup-two: start setup client network (10gigE over Infiniband) networksetup-two: ping both gtw leaf switches networksetup-two: passed networksetup-two: confirm switches occur in ib fabric networksetup-two: passed networksetup-two: verify existence of gateway ports gwp2js:no ports found for leaf1 gwp2js:input was root@xx.xx.xx.xxx's password: INTERNAL PORTS: --------------- Device Port Portname PeerPort PortGUID LID IBState GWState --------------------------------------------------------------------------- Bridge-0 1 Bridge-0-1 4 0x0010e03879ecc001 0x0003 Active Up Bridge-0 2 Bridge-0-2 3 0x0010e03879ecc002 0x0005 Active Up Bridge-1 1 Bridge-1-1 2 0x0010e03879ecc041 0x0007 Active Up Bridge-1 2 Bridge-1-2 1 0x0010e03879ecc042 0x0009 Active Up CONNECTOR 0A-ETH: ----------------- Port Bridge Adminstate Link State MTU TxPause RxPause ------------------------------------------------------------------------- 0A-ETH-1 Bridge-0-2 Enabled Down Reset 9600 Global Global 0A-ETH-2 Bridge-0-2 Enabled Down Reset 9600 Global Global 0A-ETH-3 Bridge-0-1 Enabled Down Reset 9600 Global Global 0A-ETH-4 Bridge-0-1 Enabled Down Reset 9600 Global Global CONNECTOR 1A-ETH: ----------------- Port Bridge Adminstate Link State MTU TxPause RxPause ------------------------------------------------------------------------- 1A-ETH-1 Bridge-1-2 Enabled Down Reset 9600 Global Global 1A-ETH-2 Bridge-1-2 Enabled Down Reset 9600 Global Global 1A-ETH-3 Bridge-1-1 Enabled Down Reset 9600 Global Global 1A-ETH-4 Bridge-1-1 Enabled Down Reset 9600 Global Global gwp2js:exit 1 *** gwp2js *** Out of branches near "fail <- generate json for gw ports" called from "parse ports from expect" *** gwp2js *** Syntax error on line 33: ^(012) networksetup-two: generation of leaf1gwp.json failed
CauseThis is the full error message that you get when there are no ports available, i.e all states for the ports are down. This can be caused by the following: 1. Not being connected to the Customer's 10GbE switch or it is not enabled. OR 2. The cabling is not correct. OR 3. Not being connected correctly to the ports. SolutionThe following suggestions are given for troubleshooting and resolving the issue. 1. Work with the network administrator to bring the gateway ports up. 3. This may indicate a likely link failure between the 10GbE gateway switch in BDA and the customer's 10GbE switch. The ports on the customer's 10GbE switch may be in shutdown or disabled state and need to be manually enabled. Depending on the make and model of the switch they may be disabled by default, refer to the specific switches documentation for assistance. If the ports are enabled on both end of the switches then further troubleshooting of the cable and transceivers may be necessary to determine why the link is not coming up. Here is an example of a successful run of networksetup-two on a 12 node cluster: [root@bda1node01 network]# ./networksetup-two -V NO | tee /tmp/network-conf.out
networksetup-two: analyse /opt/oracle/bda/BdaDeploy.json networksetup-two: passed networksetup-two: checking for BdaExpansion.json networksetup-two: ping server ips on admin network networksetup-two: passed networksetup-two: test ssh server ips on admin network networksetup-two: passed networksetup-two: run connected network post script on each server networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for xx.xx.xx.xx networksetup-two: post network setup for this node networksetup-two: ping servers by name on admin network networksetup-two: passed networksetup-two: verify infiniband topology networksetup-two: passed networksetup-two: start setup client network (10gigE over Infiniband) networksetup-two: ping both gtw leaf switches networksetup-two: passed networksetup-two: confirm switches occur in ib fabric networksetup-two: passed networksetup-two: verify existence of gateway ports networksetup-two: passed networksetup-two: ping server ips on admin network networksetup-two: passed networksetup-two: ping servers by name on admin network networksetup-two: passed networksetup-two: test ssh server ips on admin network networksetup-two: passed networksetup-two: test unique gw instance id networksetup-two: passed networksetup-two: verify vlan for port 0A-ETH-1 on bda1sw-ib2 networksetup-two: no vlan for port, create it networksetup-two: verify vlan for port 0A-ETH-1 on bda1sw-ib2 networksetup-two: verify vlan for port 0A-ETH-1 on bda1sw-ib3 networksetup-two: no vlan for port, create it networksetup-two: verify vlan for port 0A-ETH-1 on bda1sw-ib3 networksetup-two: passed networksetup-two: apply eoib on each server networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: wait a few seconds for the network to restart on xx.xx.xx.xx networksetup-two: check and delete vNIC for bda1node02 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node02 on switch bda1sw-ib3 networksetup-two: check and delete vNIC forbda1node02 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node02 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node02 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node02 on switchbda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node03 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node03 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node03 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node03 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node03 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node03 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node04 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node04 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node04 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node04 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node04 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node04 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node05 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node05 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node05 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node05 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node05 on switch da1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node05 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node06 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node06 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node06 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node06 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node06 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node06 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node07 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node07 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node07 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node07 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node07 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node07 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node08 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node08 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node08 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node08 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node08 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node08 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node09 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node09 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node09 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node09 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node09 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node09 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node10 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node10 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node10 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node10 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node10 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node10 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node11 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node11 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node11 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node11 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node11 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node11 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: check and delete vNIC for bda1node12 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node12 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node12 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node12 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node12 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node12 on switchbda1sw-ib3 networksetup-two: vNIC created networksetup-two: apply eoib on this node networksetup-two: network will restart momentarily networksetup-two: check and delete vNIC for bda1node01 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node01 on switch bda1sw-ib3 networksetup-two: check and delete vNIC for bda1node01 on switch bda1sw-ib2 networksetup-two: check and delete vNIC for bda1node01 on switch bda1sw-ib3 networksetup-two: create vNIC eth9 bda1node01 on switch bda1sw-ib3 networksetup-two: vNIC created networksetup-two: create vNIC eth8 bda1node01 on switch bda1sw-ib2 networksetup-two: vNIC created networksetup-two: test client network (eoib) resolve and reverse resolve networksetup-two: passed networksetup-two: test client name array matches ip array networksetup-two: passed networksetup-two: ping servers on client network by ip networksetup-two: passed networksetup-two: ssh into servers on client network by name networksetup-two: passed networksetup-two: test ntp servers networksetup-two: passed networksetup-two: ping client gateway networksetup-two: passed networksetup-two: test arp -a networksetup-two: passed networksetup-two: test vnics for all nodes host if status actv primary switch gw port ping gw ============== === ====== ==== === ====================== ========= ====== bda1node01 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node01 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node02 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node02 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node03 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node03 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node04 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node04 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node05 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node05 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node06 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node06 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node07 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node07 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node08 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node08 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node09 eth8 up no no bda1sw-ib2 0A-ETH-1 yes bda1node09 eth9 up yes yes bda1sw-ib3 0A-ETH-1 yes bda1node10 eth8 up no no bda1sw-ib3 0A-ETH-1 yes bda1node10 eth9 up yes yes bda1sw-ib2 0A-ETH-1 yes bda1node11 eth8 up no no bda1sw-ib3 0A-ETH-1 yes bda1node11 eth9 up yes yes bda1sw-ib2 0A-ETH-1 yes bda1node12 eth8 up no no bda1sw-ib3 0A-ETH-1 yes bda1node12 eth9 up yes yes bda1sw-ib2 0A-ETH-1 yes networksetup-two: end setup client network
Attachments This solution has no attachment |
||||||||||||||||
|
||||||||||||||||