T7-1, T7-2, T7-4 How to update To Hardware Programmables 1.0.9 and System FirmWare 9.7.4 or higher

Asset ID:	1-71-2262308.1
Update Date:	2018-05-23
Keywords:

Solution Type Technical Instruction Sure

Solution 2262308.1 : T7-1, T7-2, T7-4 How to update To Hardware Programmables 1.0.9 and System FirmWare 9.7.4 or higher

Applies to:

SPARC T7-4 - Version All Versions to All Versions [Release All Releases]
SPARC T7-1 - Version All Versions to All Versions [Release All Releases]
SPARC T7-2 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Goal

PROBLEM OVERVIEW: How to update System FPGA firmware and system firmware 9.7.4 or higher

Note: sysFW 9.7.4 is the minimum sysFW that works with this Hardware Programmables patch but isn't the latest sysFW for the T7 systems. Please check the following MOS docs for the latest T7 sysFW available:

SPARC T7-1 Firmware and Patches (Doc ID 1957787.1)
SPARC T7-2 Firmware and Patches (Doc ID 1984008.1)
SPARC T7-4 Firmware and Patches (Doc ID 1984031.1)

This release of Hardware Programmables updates certain versions of MB FPGAs and CPU FPGAs to better handle POK events

Please see patch README for more details

Notes :

The Hardware Programmables update procedure is the same for T7-1, T7-2, T7-4 servers
System firmware 9.7.4 or higher is required for the FPGA updates to be active. It is required to follow the order of the procedure in this document which does system firmware then FPGA programmables
Since pulling of AC power cords is required, physical access to the system is required
Loading of the FPGA firmware via the BUI/GUI is not supported. Use of the SP serial port connection is recommended so that the prompting of when to power cycle the system can be seen as well as unforeseen problems.
If an attempt is made to install the Hardware_Programmables-1.0.9-SPARC_T7-1+T7-2+T7-4.pkg file on a system where the installation is not required, the installation will not update. Upon restarting of the Service Processor, the Service Processor event logs will provide additional information.

Caution : do not interrupt power to the system while the upgrade is in progress

FPGA package is on MOS via:

Patch 25209863: FIRMWARE: SPARC T7-1+T7-2+T7-4 -SYSTEMS HW PROGRAMMABLES 1.0.9 (To be use with ILOM 3.x & lower version only)

Patch 26964013: FIRMWARE: SPARC T7-1+T7-2+T7-4 -SYSTEMS HW PROGRAMMABLES 1.0.9.A (to be use with ILOM 4.x & lower version only)

Solution

WHAT SKILLS DOES THE ENGINEER NEED: SPARC T7-1, T7-2, and T7-4 product training/experience

TASK COMPLEXITY: 2

TIME ESTIMATE: 120 minutes

FIELD ENGINEER INSTRUCTIONS

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY? :

a) Not have any disabled components or faults

b) Serial connection to SP established is recommended, Installation through network connect to SP is possible

c) System powered down

WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

There are specific instructions to follow to successfully upgrade the T7-x FPGA firmware:

1. Before taking any action the current status of the system needs to be determined

a) Run and save a "normal" level snapshot. Collecting snapshot on ILOM 3.x and later platforms (Doc ID 1020204.1)

b) Determine if system is already at system firmware version 9.7.4 or higher. which is required for the FPGA update

c) Check for any disabled components. From ILOM prompt run the command ..... -> show disabled

d) Check for any fault diagnosis. From ILOM prompt run the command ..... -> show faulty

e) If any disabled components or faults are found resolved then before proceeding with the FPGA firmware upgrade

2. Recommend establishing access as the root user to the SP(service processor) via the serial mgt port. Oracle Integrated Lights Out Manager (ILOM) 3.1

Connection and access as root user to the SP network management port is also possible

3. Connect to system console. .... -> start /SP/console

4. Halt Solaris and return to ILOM

5. Power off the system....-> stop /SYS

6. Confirm system power is off.....-> show /SYS Output should show....power_state = Off

7. If system firmware is not at version 9.7.4 or higher upgrade now while system is powered off and before FPGA upgrade is done. System firmware(not the FPGA firmware) can be done via the BUI/GUI or command line but recommendation is to complete entire FPGA and System Firmware process through CLI.

For instruction on updating system firmware please see...SPARC T7 Series Servers Administration Guide ... section "Update System Firmware"

8. The command line syntax to load the FPGA firmware is........ load -source <protocol>://<xxx.xxx.xx.xxx>/<pathname>

    <protocol> is the transport mechanism used, for example http, sftp, etc...
    <xxx.xxx.xx.xxx> is the IP address of the host that provides the ILOM update image file
    <pathname> is the full pathname of the System Firmware update image file on host <xxx.xxx.xx.xxx>

Example using http :

load -source http://100.0.0.0/Hardware_Programmables-1.0.9-SPARC_T7-1+T7-2+T7-4.pkg

A document that explains the options for how to use the "load -source" protocol options and syntax is...How to upgrade the firmware using the ILOM CLI , for SPARC CMT Servers (Doc ID 2101665.1)

Caution : do not interrupt power to the system while the upgrade is in progress

9. During the install the following questions will be asked to which the answer is.....y

Are you sure you want to load the specified file (y/n)? y <<<< note the Y response
This may take up to 10 minutes. At the end of the installation, the Service
Processor will be halted and you MUST AC power cycle the system to complete
installation. Do you wish to continue (y/n)? y<<<< note the Y response

10. You will be prompted to remove AC power:

If updating from the serial console, wait until the message : "It is now safe to poweroff the system" appears.

If updating from an ssh session, wait until the session is terminated at the end of the installation, then wait 1 more minute for ILOM to shutdown.

It is now safe to poweroff the system..<<<< Safe to Remove AC at this point remove AC power cords for 2 minutes.

11. When prompted log into the SP at root. Power on the system......-> start /SYS

12. System will run through power and POST.

a) check for any disabled devices...-> show disabled

b) check for any faults...-> show faulty

c) run and save a new "after upgrades" snapshot

13. The following are examples of successful upgrade, logs, and version verification methods

Example output of a successful installation using the Oracle ILOM CLI on a SPARC T7-2 system:

-> load -source http://192.x.x.x/Hardware_Programmables-1.0.9-SPARC_T7-1+T7-2+T7-4.pkg

NOTE: An upgrade takes several minutes to complete. ILOM
will enter a special mode to load new firmware. No
other tasks can be performed in ILOM until the
firmware upgrade is complete and ILOM is reset.

Are you sure you want to load the specified file (y/n)? y
This may take up to 30 minutes. At the end of the installation, the Service Processor
will be halted and you MUST AC power cycle the system to complete installation. Do you
want to continue (y/n)? y
..................Updating /SYS/MB/FPGA with T7-2_P1_0_V11_3_3_1.svf....................................................................done
Updating /SYS/MB/CM0 with T7M_V2_4_1.svf....................................................................done
Updating /SYS/MB/CM1 with T7M_V2_4_1.svf...................................................................done

Example output of a successful installation using the Oracle ILOM CLI on a SPARC T7-4 system:

-> load -source http://10.x.x.x/peter/Hardware_Programmables-1.0.9-SPARC_T7-1+T7-2+T7-4.pkg

Are you sure you want to load the specified file (y/n)? y
This may take up to 50 minutes. At the end of the installation, the Service Processor will be halted and you MUST AC power cycle the system
to complete installation. Do you want to continue (y/n)? y
.......................Updating /SYS/MB/FPGA with T7_4_V12_1_3_0.svf...........................................................................................done
Updating /SYS/PM0/CM0 with T7M_V2_4_1.svf...................................................................done
Updating /SYS/PM0/CM1 with T7M_V2_4_1.svf...................................................................done
Updating /SYS/PM1/CM0 with T7M_V2_4_1.svf..........................................................................done
Updating /SYS/PM1/CM1 with T7M_V2_4_1.svf...................................................................done

Examples of Service Processor log events for a successful installation:

For FPGAs which were successfully updated, the Service Processor event log will contain entries like these:

-> show /SP/logs/event/list/

293 Tue Apr 4 22:02:38 2016 System Log major

Service Processor halting in preparation of AC powercycle.

292 Tue Apr 4 22:02:37 2016 System Log major

End install of Hardware_Programmables-1.0.9-SPARC_T7-2

291 Tue Apr 4 22:02:36 2016 System Log major

AC powercycle required to complete installation.

290 Tue Apr 4 22:02:36 2016 System Log major

Devices updated. System being shutdown.

289 Tue Apr 4 22:02:35 2016 System Log major

Install of Hardware_Programmables-1.0.9-SPARC_T7-2 successful

288 Tue Apr 4 22:02:35 2016 System Log major

Hardware_Programmables-1.0.9-SPARC_T7-2 applied to /SYS/MB/CM1

287 Tue Apr 4 21:56:35 2016 System Log major

Hardware_Programmables-1.0.9-SPARC_T7-2 applied to /SYS/MB/CM0

286 Tue Apr 4 21:50:36 2016 System Log major

Hardware_Programmables-1.0.9-SPARC_T7-2 applied to /SYS/MB/FPGA.

285 Tue Apr 4 21:44:21 2016 System Log major

Beginning install of Hardware_Programmables-1.0.9-SPARC_T7-2

Examples of Service Processor log events for no update required:

For FPGAs which did not require update, the Service Processor event log will contain entries like these:

-> show /SP/logs/event/list/

281 Tue Apr 4 21:32:50 2016 System Log major

End install of Hardware_Programmables-1.0.9-SPARC_T7-2

280 Tue Apr 4 21:32:50 2016 System Log major

Install of Hardware_Programmables-1.0.9-SPARC_T7-2 successful. No

updates required

279 Tue Apr 4 21:32:49 2016 System Log major

/SYS/MB/CM1 does not require update

278 Tue Apr 4 21:32:47 2016 System Log major

/SYS/MB/CM0 does not require update

277 Tue Apr 4 21:32:45 2016 System Log major

/SYS/MB does not require update

276 Tue Apr 4 21:32:42 2016 System Log major

Beginning install of Hardware_Programmables-1.0.9-SPARC_T7-2

Example of the error message after load source in ILOM CLI, indicate to check ILOM SP event logs:

An error occurred during the upgrade, please check the SP log for detailed information.

Version: 100.1.0.9
Start update of: T7 FPGA Update v1.0.9 for T7-1, T7-2, or T7-4.
Finish update of: T7 FPGA Update v1.0.9 for T7-1, T7-2, or T7-4.

upgrade failed: Embedded script execution failed

Firmware image update failed.
load: Command Failed

Examples of Service Processor log events for a failed installation due to outdated firmware version:

-> show /SP/logs/event/list/

281 Tue Apr 4 21:12:50 2016 System Log major

End install of Hardware_Programmables-1.0.9-SPARC_T7-2.

280 Tue Apr 4 21:12:50 2016 System Log major

Please update to Sun System Firmware 9.7.4 or later before applying Hardware_Programmables-1.0.9-SPARC_T7-1+T7-2+T7-4.pkg.

Examples of Service Processor log events for a failed installation due to Host Poweron:

-> show /SP/logs/event/list

Event

ID Date/Time Class Type Severity

----- ------------------------ -------- -------- --------

1018 Mon Apr 10 17:53:28 2017 System Log major

End install of Hardware_Programmables-1.0.9-SPARC_T7-2.

1017 Mon Apr 10 17:53:27 2017 System Log major

Please manually power off Host to activate this patch.

1016 Mon Apr 10 17:53:26 2017 System Log major

Host power is not off.

1015 Mon Apr 10 17:53:25 2017 System Log major

Beginning install of Hardware_Programmables-1.0.9-SPARC_T7-2

Additional methods to verify the update was successful:

The FW update can be verified via the restricted shell.

1. Enter the Restricted Shell from anywhere in the Oracle ILOM CLI

-> set SESSION mode=restricted

WARNING: The "Restricted Shell" account is provided solely

to allow Services to perform diagnostic tasks.

[(restricted_shell) <hostname>:~]#

2. Using the hw version command to find the current FW versions on the current FPGAs.

T7-1 FPGA versions:

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/FPGA

0. /SYS/MB/FPGA (FPGA) FPGA Version: 10.3.0.5

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/CM/FPGA

1. /SYS/MB/CM/FPGA (CPUMFPGA) FPGA Version: 3.2.4.1

T7-2 FPGA versions:

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/FPGA

0. /SYS/MB/FPGA (FPGA) FPGA Version: 11.3.3.1

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/CM0/FPGA

1. /SYS/MB/CM0/FPGA (CPUMFPGA) FPGA Version: 3.2.4.1

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/CM1/FPGA

2. /SYS/MB/CM1/FPGA (CPUMFPGA) FPGA Version: 3.2.4.1

T7-4 FPGA versions:

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/FPGA

0. /SYS/MB/FPGA (FPGA) FPGA Version: 12.1.3.0

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/PM0/CM0/FPGA

1. /SYS/MB/PM0/CM0/FPGA (CPUMFPGA) FPGA Version: 3.2.4.1

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/PM0/CM1/FPGA

2. /SYS/MB/PM0/CM1/FPGA (CPUMFPGA) FPGA Version: 3.2.4.1

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/PM1/CM0/FPGA

3. /SYS/MB/PM1/CM0/FPGA (CPUMFPGA) FPGA Version: 3.2.4.1

[(restricted_shell) <hostname>:~]# hw version | grep /SYS/MB/PM1/CM1/FPGA

4. /SYS/MB/PM1/CM1/FPGA (CPUMFPGA) FPGA Version: 3.2.4.1

3. The version should read as above. If it doesn't, please check the SP event logs for more information.

4. Exit the restricted shell and go back to the Oracle ILOM prompt.

[(restricted_shell) <hostname>:~]# exit

exit

Attachments

This solution has no attachment