Oracle Virtual Networking - After Upgrade to 4.0.7 XgOS, QDR IB Switch F/W is Not Changed

Asset ID:	1-72-2204491.1
Update Date:	2017-12-19
Keywords:

Solution Type Problem Resolution Sure

Solution 2204491.1 : Oracle Virtual Networking - After Upgrade to 4.0.7 XgOS, QDR IB Switch F/W is Not Changed

Applies to:

Oracle Fabric Interconnect F1-4 - Version All Versions to All Versions [Release All Releases]
Oracle Fabric Interconnect F1-15 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

After upgrade to 4.0.7 XgOS, the QDR IB Switch F/W for the internal QDR Switches in the Fabric Interconnects still show the old/original version:

admin@xsigo2[xsigo] show diagnostics switch-version
Image type: FS2
FW Version: 7.3.0
Device ID: 48436
Description: Node Sys image
GUIDs: 001397010a000528 001397010a000528
Board ID: (XG_WHSK_QDR_01)
VSD:
PSID: XG_WHSK_QDR_01

Changes

Upgrade to 4.0.7 XgOS on the Fabric Interconnects, this version of XgOS has a new QDR IB Switch F/W image.

Cause

There is a bug in the automated QDR IB Switch F/W upgrade scripts

Solution

** First, confirm that OpenSM is running properly using "show diagnostics opensm-param"

** From the admin CLI, gather the output of "show diagnostics switch-version". This will display the GUID of your internal switch (sample output below)

admin@ovn[xsigo] show diagnostics switch-version

<<SAMPLE OUTPUT>>

Image type: FS2
FW Version: 7.3.120 <----------------- This is the current running IB Switch firmware version on the system.
Device ID: 48438
Chip Revision: A0
Description: Node Sys image
GUIDs: 1397010A000261 1397010A000261 <---------------- Internal switch GUID

** Then, locate the internal switch LID:

Issue the admin CLI command "show diagnostics ib-topo" and output to a file. You will need to locate the LID associated with the GUID noted above

Type Name Node Guid Port Port Guid Lid Neighbor(guid, port) OperState portName
---------------------------------------------------------------------------------------------------------------------------
Switch Xsigo QDR Switch 1397010A000261 1 1397010A000261 22 0 0 DOWN (sdr)

** Identify current switch Firmware:
Once you have the LID (for example, LID 22 is used in the command below), confirm the current running firmware.

admin@ovn[xsigo] show diagnostics switch-version

<<SAMPLE OUTPUT>>
Image type: FS2
FW Version: 7.3.120 <----------------- This is the current running version on the system.
Device ID: 48438
Chip Revision: A0
Description: Node Sys image
GUIDs: 1397010A000261 1397010A000261

# remount /opt/xsigo/xsigos/current RW
# cp /opt/xsigo/xsigos/current/scripts/xg-qdr-master.bin /opt/xsigo/xsigos/current/images/

For 4.0.10 XgOS the file location / command above needs to be run like this:

cp /opt/xsigo/xsigos/xsigos-4.0.10-XGOS-RC1B/images/xq-qdr-master.bin /opt/xsigo/xsigos/xsigos-4.0.10-XGOS-RC1B/scripts/xg-qdr-master.bin

Follow the rest of the process for all XgOS versions:
# cd /opt/xsigo/xsigos/current/scripts
# chmod +x burn_qdr_sw_img.sh
# ./burn_qdr_sw_img.sh <switch_lid> xg-qdr-master.bin
# su admin

** At this point, the Fabric Interconnect will require a restart to use the updated firmware:

# system cold-restart

** The new version should be 7.4.3002, once the system restarts, verify using either root or admin cli commands -

root:

# cd /opt/xsigo/xsigos/current/ofed/bin/
./xg_flint -d lid-22 query

admin:

admin@ovn[xsigo] show diagnostics switch-version

4.0.10 XgOS available on MOS, still requires the manual install of the IB Switch firmware when upgrading to 4.0.10 XgOS, specifically for a problem found with Gen2 Front Panels. Upcoming 4.0.11 XgOS was created to resolve this bug and is currently being tested. Gen2 Front Panels can be seen by running the command below as user 'admin':

# show hardware

Relevant output from "show hardware" command showing Gen2 Front Panel:

## Front Panel Version status ################################################

model serial xt-ver primary-boot-ver secondary-boot-ver diag-ver
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
VP-FRU-FP-C7 341321110 4.00.27 4.00.12 4.27 <===> the "C7" of the model # denotes a Gen2 Front Panel, a Gen1 Front Panel will not show "C7"
1 record displayed

It has been confirmed that 4.0.11 XgOS posted on MOS, now *automatically* upgrades the OVN F1-15 Fabric Interconnects internal Mellanox IB Switches to v7.4.3002, the manual kludge noted above to upgrade the internal Mellanox IB Switch F/W does not need to be performed when using 4.0.11 XgOS.

26639070 XsOS 4.0.11 Patch

Attachments

This solution has no attachment