Sun ZFS Storage Appliance: How to update the BIOS for a 7x20 NAS appliance

Asset ID:	1-71-1357409.1
Update Date:	2018-05-10
Keywords:

Solution Type Technical Instruction Sure

Solution 1357409.1 : Sun ZFS Storage Appliance: How to update the BIOS for a 7x20 NAS appliance

Applies to:

Sun ZFS Storage 7420 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7320 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7120 - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)
NAS head revision : [2010.Q3.2.1 and later]
BIOS revision : [08040110|09020115|...]
ILOM revision : [3.x]
JBODs Model : [not dependent]
CLUSTER related : [not dependent]

Goal

Assist TSC and field / partner engineers with 7000 appliance SP/BIOS upgrade.

Solution

Please read and understand all steps before proceeding with the Service Processor (SP) upgrade.

NOTE FOR PARTNER ENGINEERS: Please ensure only engineers trained in how to support ZFSSA perform BIOS upgrades.

To check the Service Processor BIOS version refer to this document:
Sun Storage 7000 Unified Storage System: How to check the SP BIOS revision level [Document 1174698.1 ]

This document assumes you are able to connect/login to a pre-configured SP via network IP address.

To upgrade the SP/ILOM and BIOS on the Sun Storage 7x20 do the following :

BIOS upgrade

The version of code is an example only.

7000SP login: root

Password: 
Oracle(R) Integrated Lights Out Manager
Version 3.0.9.25 r57756
Copyright (c) 2010, Oracle and/or its affiliates. All rights reserved.

Next check the BIOS with:

-> cd /SYS/MB/BIOS
/SYS/MB/BIOS

-> show

/SYS/MB/BIOS
Targets:

Properties:
type = BIOS
ipmi_name = MB/BIOS
fru_name = SYSTEM BIOS
fru_description = SYSTEM BIOS
fru_manufacturer = AMERICAN MEGATRENDS
fru_version = 09020115
fru_part_number = AMIBIOS8

The 7120 and 7320 systems share the same system board, hence use the same BIOS. The 7420 has separate system board and requires different code.

The SP firmware and BIOS are updated at the same time from a single image. It is handy to have a terminal window with a serial connection to the SP open at this stage.

The updating is done via a browser, but the subsequent reboot can be observed via the open serial connection.

NOTE: It seems that the SP and BIOS cannot be upgraded from Firefox, need to use Internet Explorer.

When clicking the Maintenance-> "firmware upgrade" subtab, it shows an empty page without any error messages. Upgrade can only be completed successfully when using Internet Explorer.

Internet Explorer is known to be totally absent from the *nix-based gateways used to connect to our customers' devices.

There is the possibility to load the BIOS/ILOM firmware using FTP ... for cases when a direct local connection is not an option:

Download the appropriate version of BIOS/SP for the head you are working on.

The file has been compressed for download as a generic .zip file.

p******_*_Generic.zip

The file will need to be unzipped before it can be downloaded to the NAS.

NOTE: The file to be download always ends in a .pkg suffix.

Set up a ftp share on your customers array with the following instructions:

    NAS:> shares
    NAS:shares> ls
    Properties:
    pool = pool-3a

    Projects:
            default
            dot

    Children:
            replication => Manage remote replication
            schema => Define custom property schema

    NAS:shares> select default
    NAS:shares default> filesystem bios
    NAS:shares default/bios (uncommitted)> set shareftp=rw
    shareftp = rw (uncommitted)
    NAS:shares default/bios (uncommitted)> commit

Enable FTP on the customers system making sure to allow root login:

    NAS:> cd /
    NAS:> configuration services ftp
    NAS:configuration services ftp> ls
      Properties:
                  <status> = disabled
               listen_port = 21
              tls_required = false
                  tls_port = 21
                root_login = false
              delay_engine = false
        max_login_attempts = 3
           max_connections = 30
         logging_verbosity = notice
              default_root = /
                     umask = 022
     allow_foreign_address = false

    NAS:configuration services ftp> set root_login=true
    root_login = true (uncommitted)
    NAS:configuration services ftp> commit
    NAS:configuration services ftp> enable

Push the BIOS/SP code package to the FTP share using normal FTP commands ... eg. put <FILE>

Drop to the ILOM by using ESC-( <== These are two separate key strokes. First ESC, then the shift and the key containing '('

(Mac users will need to use the CTRL+[ key in place of the esc key)

Now use the FTP share you just created to load the code to the SP. Once the code is loaded the system and the SP will reboot to activate the files automatically.
This will use the IP of the array and the name of your file. Make sure you use the name of the file you uploaded and the customer's IP address.

-> load -source ftp://root:changeme@<APPLIANCE_IP_ADDRESS>/export/bios/path_to_ilom_package.pkg <=== path to the file you just uploaded to the ftp share

NOTE: A firmware upgrade will cause the server and ILOM to be reset. It is recommended that a clean shutdown of the server be done prior to the upgrade procedure.
              An upgrade takes about 6 minutes to complete. ILOM will enter a special mode to load new firmware.
              No other tasks can be performed in ILOM until the firmware upgrade is complete and ILOM is reset.

        Are you sure you want to load the specified file (y/n)? y
        Do you want to preserve the configuration (y/n)? y
        ...............................................................................................

        Firmware update is complete.
        ILOM will now be restarted with the new firmware.

        ->

NOTE: You will lose your ILOM connection here. You may have to hit RETURN before it dies. Open a new connection to the ILOM.

NOTE: There is a 16 MB file limit that only affects local files being upload via the BUI in ILOM SW 1.6.1 and earlier.

For the detail, please refer to the following MOS document: Doc ID 2205130.1 (Oracle ZFS Storage Appliance: SP/BIOS Upgrade via ILOM BUI Fails with "Package structure is corrupted")

To update, point a browser at the SP, log in as root and follow these steps:

Click on main Maintenance tab
Firmware Upgrade will be the default and correct subtab
Click on [Enter Upgrade Mode]
Confirm this action in the pop-up
Click on [Browse] and select the appropriate image from your local filesystem. You can find the BIOS images here: https://stbeehive.oracle.com/teamcollab/wiki/ZFSSAFieldSupport:SP+BIOS+Version ***Please see "comments" at the end of the doc for Wiki access instructions. This may be subject to future change ***.
We also have these knowledge documents that have the latest versions listed with links to the appropriate patch package:
Oracle ZFS Storage Appliance: Critical Security bug fixes for ZFSSA BIOS/ILOM (October 2015) (Doc ID 2054991.1)
Oracle ZFS Storage Appliance: Critical Security bug fixes for ZFSSA BIOS/ILOM (April 2016)(Doc ID 2177437.1)
Oracle ZFS Storage Appliance: Critical Security bug fixes for ZFSSA BIOS/ILOM (October 2016)(Doc ID 2222104.1)
Oracle ZFS Storage Appliance: Critical Security bug fixes for ZFSSA BIOS/ILOM (April 2017)(Doc ID 2280467.1)
Oracle ZFS Storage Appliance: Critical Security bug fixes for ZFSSA BIOS/ILOM (October 2017) (Doc ID 2351298.1)
If you are unsure of the correct version please contact support for assistance and do not proceed with the upgrade.
1. Click on [Upload]
2. Wait for upload to complete and the verification to succeed
3. You will now see a Summary Table of the SP firmware and BIOS versions (Existing vs New). Confirm that "Preserve existing configuration" is checked for the SP Firmware.
4. Click on [Start Upgrade]
5. Confirm this action in the pop-up
6. Now wait for the upgrade to proceed. If the head was up at this point, it will be cleanly shutdown. Warning! Do not interrupt the update. Leave the browser undisturbed until the update is complete. You may consider shutting the node down prior to move resources off in a cluster.
7. When finished, you will see "Upgrade Complete and the SP will reboot. This is where it is handy to have the SP serial window open.
BIOS settings

The SP firmware and BIOS will now have been updated to the correct 7x20 version. Now you must configure some specific BIOS settings. Boot the head and enter setup with:

-> cd /HOST
-> set /HOST boot_device=bios

-> start /SYS
Are you sure you want to start /SYS (y/n)? y
Starting /SYS

-> start /SP/console
Are you sure you want to start /SP/console (y/n)? y

Serial console started.  To stop, type ESC (*in some situations you may need to substitute " ESC ( " with " ctrl [ ( "

Once you see the initial BIOS banner, hit CONTROL-E a few times (If you did not set /HOST boot_device=bios); this will trigger the BIOS Setup menu after the installation. You can drop back to the SP with ESC (
- The boot_device setting is a one-time deal, so its not permanent and will stay in effect for 10 minutes applying to the next boot cycle which is triggerred by the "start /SYS".

NOTE: Escape, followed by shift 9 -- at least open parenthesis is usually on shift 9. Once into the BIOS Setup screen, start by loading factory defaults. To do this, use the "right arrow" key to move over to the "Exit"; menu. "Down arrow" to "Load Optimal Defaults" and, then again to confirm the pop-up asking "Load Optimal Defaults.

Next refer to the following knowledge documents for the specific instructions for the appropriate appliance:

7120 BIOS

NOTE: Oracle internal can also refer to this document:

Sun ZFS Storage Appliance: 7120 - Required BIOS Settings (Doc ID 2107965.1)

Disable PCI-E Option-ROM scanning for all non-NET slots in Boot Menu.
Enable Persistent Boot Mode.
Select HDD boot devices.

Use the right arrow key to page over to the "Boot" menu. Use the down arrow to select:
Option ROM Enable

In patchId 19971536 the PCI-E option is not available -- Skip to the Expert Boot Mode and set Persistent Boot Mode [Enabled], reboot and then set the Boot Device Priority

Press return, and then in the sub-menu use the down arrow to select:
PCI-E Slot 0 Option ROM: [Enabled]

Press return and select "Disabled", followed by return. This will now appear as:
PCI-E Slot 0 Option ROM: [Disabled]
Repeat this for all PCI-E slots (1-5) in this sub-menu.

Press ESC to return to the top-level "Boot" menu and enter Expert Mode by pressing CONTROL-U. This will prompt with:

*************************************************************
* *
* WARNING: The mode you are enabling is for expert users *
* only (field service personnel, etc.). Modifying certain *
* settings while in this mode may render your system *
* inoperable. *
* *
* Are you sure you want to enable expert mode? *
* *
*************************************************************
* [Ok] [Cancel] *
*************************************************************

At this point select OK to enter Expert Mode. Once Expert Mode has been enabled, enter the sub-menu:
Boot Setting Configuration
Use the arrow key to move down and select:
Persistent Boot Mode [Disabled]

Press return and select [Enabled], followed by return. This will now appear as:
Persistent Boot Mode [Enabled]

Press ESC to return to the top-level "Boot" menu. Use right arrow to page over to "Exit" Press return for the default "Save Changes and Exit" and again to confirm the action with the pop-up. This will cause the appliance to reboot. You will need to re-enter the BIOS Setup in order to set the boot device priority. Once again use CONTROL-E to enter BIOS Setup when the BIOS screen first loads.

NOTE: Attempting to set the boot device priority without performing this extra reboot may result in an incorrectly configured boot device priority.
NOTE: Attempting to set the boot device priority without performing this extra reboot may result in an incorrectly configured boot device priority.

Yes its here twice, hopefully you followed directions

Once the BIOS Setup is running use the arrow keys to navigate to the "Boot" menu and enter the sub-menu:
Boot Device Priority

You do not need to re-enable Expert Mode. Set the first two boot devices to be HDD:P0 and HDD:P1 using the "+" key to rotate the list and move these devices to the top, such that you have something similar to:

1) [P B HDD:P0-SEAGATE ST95000NSSUN500G 101]
2) [P B HDD:P1-SEAGATE ST95000NSSUN500G 101]
3) [P B PXE:IBA GE Slot 0100 v1331]
4) [P B PXE:IBA GE Slot 0101 v1331]
5) [P B PXE:IBA GE Slot 0700 v1331]
6) [P B PXE:IBA GE Slot 0701 v1331]
7) [ B PORT4]
8) [ B PORT5]
9) [ B USB Front 0]
10) [ B USB Front 1]
11) [ B USB Rear 0]
12) [ B USB Rear 1]
13) [P B USB:02.82;01 Unigen PSA4000]

Press ESC to return to the top-level "Boot" menu.

Exiting BIOS Setup: Use right arrow to page over to "Exit". Press return for the default "Save Changes and Exit", and again to confirm the action with the pop-up.

7320 BIOS

NOTE: Oracle internal can also refer to this document:

Sun ZFS Storage Appliance: 7320 - Required BIOS Settings (Doc ID 2107971.1)

Disable PCI-E Option-ROM scanning for all non-NET slots in Boot Menu.
Enable Persistent Boot Mode.
Select HDD boot devices.
Use the right arrow key to page over to the "Boot" menu. Use the down arrow to select:
Option ROM Enable
Press return, and then in the sub-menu use the down arrow to select:
PCI-E Slot 0 Option ROM: [Enabled]
Press return and select [Disabled], followed by return. This will now appear as:

PCI-E Slot 0 Option ROM: [Disabled]

Repeat this for all PCI-E slots (1 and 2) in this sub-menu.

Press ESC to return to the top-level "Boot"menu and enter Expert Mode by pressing CONTROL-U. This will prompt with:

At this state select OK to enter Expert Mode.
Once Expert Mode has been enabled, enter the sub-menu:

Boot Setting Configuration

Use the arrow key to move down and select:
Persistent Boot Mode [Disabled] << this has to remain 'as is' for 7320 only

Press ESC to return to the top-level "Boot" menu. Use right arrow to page over to "Exit". Press return for the default "Save Changes and Exit", and again to confirm the action with the pop-up.

This will cause the appliance to reboot. You will need to re-enter the BIOS Setup in order to set the boot device priority. Once again use CONTROL-E to enter BIOS Setup when the BIOS screen first loads.

NOTE: Attempting to set the boot device priority without performing this extra reboot may result in an incorrectly configured boot device priority.

Once the BIOS Setup is running use the arrow keys to navigate to the "Boot" menu and enter the sub-menu:
Boot Device Priority

1) [P B HDD:P0-SEAGATE ST95000NSSUN500G 102]
2) [P B HDD:P1-SEAGATE ST95000NSSUN500G 103]
3) [P B PXE:IBA GE Slot 0100 v1331]
4) [P B PXE:IBA GE Slot 0101 v1331]
5) [P B PXE:IBA GE Slot 0700 v1331]
6) [P B PXE:IBA GE Slot 0701 v1331]
7) [P HDD:P2-TOSHIBA THNS512GG8BBAA]
8) [P HDD:P3-TOSHIBA THNS512GG8BBAA]
9) [ B PORT4]
10) [ B PORT5]
11) [ B USB Front 0]
12) [ B USB Front 1]
13) [ B USB Rear 0]
14) [ B USB Rear 1]
15) [P B USB:02.82;01 Unigen PSA4000]

Press ESC to return to the top-level "Boot" menu.

Exiting BIOS Setup: Use right arrow to page over to "Exit". Press return for the default "Save Changes and Exit", and again to confirm the action with the pop-up.

7420 BIOS

NOTE: Oracle internal can also refer to this document:

Sun ZFS Storage Appliance: 7420 - Required BIOS Settings (Doc ID 2107975.1)

Disable PCI-E Option-ROM scanning for all non-NET slots in "PCIPnP" Menu. (Note: For 7420 M2 model, Slot 0 Option ROM setting should be "Enabled")
Disable I/O allocation for all but Cluster. (Note: For 7420 M2 model, Slot 0 I/O allocation setting should be "Enabled")
Enable Persistent Boot Mode.
Select HDD boot devices.
Use the right arrow key to page over to "PCIPnP" menu. Use the down arrow to highlight:
PCI-E Slot 2 Option ROM: [Enabled]

Press return and select "Disabled", followed by return. This will now appear as:
PCI-E Slot 2 Option ROM: [Disabled]

Repeat this for all slots (there are more off the bottom).

Just below these OPROM settings are a group of settings which allow IO allocation to be disabled per-slot. Disable all but the final entry, which will likely need enabling. The last few lines should look like:

I/O Allocation for Slot 7 [Disabled]
I/O Allocation for Slot 8 [Disabled]
I/O Allocation for Slot 9 [Disabled]
I/O Allocation for Cluster [Enabled]

NOTE: For 7420 M2 - Both Option ROM and I/O Allocation must be enabled for PCI slot 0.

Use the right arrow key to page over to "Boot" menu and enter Expert Mode by pressing CONTROL-U. This will prompt with:

At this point select OK to enter Expert Mode.
Once Expert Mode has been enabled, enter the sub-menu:
Boot Setting Configuration

Use the arrow key to move down and select:
Persistent Boot Mode [Disabled]

Press return and select "Enabled", followed by return. This will now appear as:
Persistent Boot Mode [Enabled]

Press ESC to return to the top-level "Boot" menu. Use right arrow to page over to "Exit". "Press return for the default" Save Changes and Exit", and again to confirm the action with the pop-up.
This will cause the appliance to reboot. You will need to re-enter the BIOS Setup in order to set the boot device priority. On the second boot you must use CONTROL-E to enter BIOS Setup when the BIOS screen first loads.

NOTE: Attempting to set the boot device priority without performing this extra reboot may result in an incorrectly configured boot device priority.

Once the BIOS Setup is running use the arrow keys to navigate to the "Boot" menu and enter the sub-menu:
"Boot Device Priority"

1) [P B HDD:P0-SEAGATE ST95000NSSUN500G 102]
2) [P B HDD:P1-SEAGATE ST95000NSSUN500G 102]
3) [ B HDD2]
4) [ B HDD3]
5) [ B HDD4]
6) [ B FMOD]
7) [ B USB0]
8) [ B USB1]
9) [P B PXE:IBA GE Slot 6100 v1335]
10) [P B PXE:IBA GE Slot 6101 v1335]
11) [P B PXE:IBA GE Slot 8100 v1335]
12) [P B PXE:IBA GE Slot 8101 v1335]
13) [P HDD:P2-TOSHIBA THNS512GG8BBAA]
14) [P HDD:P3-TOSHIBA THNS512GG8BBAA]
15) [P HDD:P4-TOSHIBA THNS512GG8BBAA]
16) [P HDD:P5-TOSHIBA THNS512GG8BBAA]
17) [P USB:ExtPort0:Unigen PSA4000]

Press ESC to return to the top-level "Boot" menu.

Exiting BIOS Setup: Use the arrow right to move to the "Exit" menu. Press return for the default "Save Changes and Exit", and return again to confirm the action with the pop-up.

Identification of Affected Parts

Connect via ssh to the Service Processor. To display the BIOS version, type "show /SYS/MB/BIOS". Alternatively, start the system with "start /SYS". The BIOS version will be displayed in the initial BIOS banner. Confirm the version for the 7x20 system BIOS just upgraded.Checking the BIOS version via other means, such as the administrative BUI/CLI can be viewed in the OS environment.

CLI: Login to CLI by providing administrative credentials and type : nas> configuration version show
BUI: Clicking on SUN/Oracle Icon Upon logging into the BUI after providing administrative credentials.

References

<NOTE:1513423.1> - Sun Storage 7000 Unified Storage System: How To Upgrade the Appliance Kit Software and Service Processor BIOS/ILOM Firmware
<NOTE:1174698.1> - Oracle ZFS Storage Appliance: How to check the SP BIOS revision level
https://stbeehive.oracle.com/teamcollab/wiki/ZFSSAFieldSupport:SP%2BBIOS+Version

Attachments

This solution has no attachment

Applies to:

Goal

Solution

BIOS upgrade

BIOS settings

Identification of Affected Parts

References