Recognizing and Troubleshooting an Incomplete System Service Processor (SP) Firmware Upgrade on T2000 Series

Asset ID:	1-72-1518881.1
Update Date:	2017-10-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1518881.1 : Recognizing and Troubleshooting an Incomplete System Service Processor (SP) Firmware Upgrade on T2000 Series

Applies to:

Sun Fire T2000 Server - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

Prior to attempting the installation of new Firmware Binary, issuing the "showhost" ALOM command will provide a view of the currently installed system firmware:

sc> showhost

Sun-Fire-T2000 System Firmware 6.5.11 2008/01/08 20:24 <--- Old Values prior to FW update

Host flash versions:

Hypervisor 1.3.4 2007/03/28 06:03 <--- Old Values

OBP 4.25.12 2008/03/23 13:27 <--- Old Values

POST 4.25.12 2008/03/23 13:52 <--- Old Values

When attempting to use the 'flashupdate' utility to upgrade the Firmware (FW) on the T2000's System Service Processor, the result is an incomplete installation of the FW binary.

If we follow the output during the FW upgrade, at first glance it appears that the new FW revision was applied successfully,

sc> flashupdate -s 1XX.1XX.X.XX -f /home/PATCHES/139434-09/Sun_System_Firmware-6_X_X2-Sun_Fire_T2000.bin

Username: admin

Password: *********

flashupdate: validating image...

Programming ALOM flash.

Erasing segment 0

Programming segment 0

Erasing segment 1

Programming segment 1

Erasing segment 2

Programming segment 2

Erasing segment 3

Programming segment 3

Erasing segment 4

~SNIP~

Programming segment 3d

Erasing segment 3e

Programming segment 3e

Erasing segment 3f

Programming segment 3f

Validating flash image crc..............ALOM was programmed successfully.

However, the positive message, shown above, is then followed by:

Error programming OBP segment into flash

Error updating software.

Upon issuing the 'showhost' ALOM command at the sc> prompt, we see the following:

sc> showhost

Sun-Fire-T2000 System Firmware 6.7.12 2011/07/06 20:03 <--- New Value

Host flash versions:

Hypervisor 1.3.4 2007/03/28 06:03 <--- Old Values

OBP 4.25.12 2008/03/23 13:27 <--- Old Values

POST 4.25.12 2008/03/23 13:52 <--- Old Values

The expected output should show:

sc> showhost

Sun-Fire-T2000 System Firmware 6.7.12 2011/07/06 20:03 <--- NEW Values

Host flash versions:

Hypervisor 1.7.3.c 2010/07/09 15:14 <--- NEW Values

OBP 4.30.4.b 2010/07/09 13:48 <--- NEW Values

POST 4.30.4.b 2010/07/09 14:24 <--- NEW Values

Cause

The cause for this issue has been determined as any of the following:

1- The System Service Processor's memory (RAM) is full or unavailable

2- The downloaded FW binary file was corrupted during download

3- The SSP is in an undefined state and cannot be recovered properly by ordinary means

Solution

Please follow these 4 steps, in order:

1- Hard-reset: this requires pulling power from the machine completely for a time (60 seconds is my general good rule). Then, retry to flash the FW again.
- Pulling power clears the SSP's RAM, thus allowing for more memory to become available

2- Downloading fresh binary (FW patch) and retrying to flash the SSP with the new binary. For our case, you have tried different patches already, so we will skip this.
- At times, during a download, binary, as with any other data, may become corrupt

3- If the issue still remains, unplug power from the machine and re-seat the SSP card, then repeat the firmware update procedure once more.

(Please refer to the following documentation on proper SP Card handling: Service Manual or relevant portion in 1308278.1 )

4- If none of the above resolve, please open a new Oracle Service Request for additional guidance as the final solution may include the replacement of the SSP Card itself.
- It has been seen in the past that on the T2000 systems, once the SSP comes to an "undefined" state, i.e. ALOM revision update Successful, but POST, Hypervisor, and OBP update Unsuccessful, (as seen in this example) the SSP can no longer be recovered by any ordinary means.

References

<NOTE:1004230.1> - Troubleshooting Firmware Upgrade Issues on a T1000/T2000

Attachments

This solution has no attachment