Description

After performing an update to the Sun ZFS Storage Appliance Software 2011.1.1.0 release, update disks may be left offline after the completion of the disk firmware upgrade to version 061A (Disk firmware upgrade is automatic with the Software update). This condition can potentially impact storage pool redundancy.

Occurrence

This issue can occur on the following platforms:

Sun ZFS 7000 Storage Appliance platforms:

• Sun ZFS 7120
• Sun ZFS 7310 (SAS2)
• Sun ZFS 7320
• Sun ZFS 7410 (SAS2)
• Sun ZFS 7420

with Sun ZFS Storage Appliance Software 2011.1.1.0 release (Disk firmware 061A)

Notes:

1. This issue only occurs on the platforms above with attached J4410 SAS2 disk shelves or on the Sun ZFS 7120 with 1TB and 2TB SAS2 data disks.

2. This issue is not observable in the Storage Software CLI or BUI.

To determine the current Storage Software revision, do the following:

7000:> maintenance system updates list

UPDATE  DATE  STATUS

ak-nas@2011.04.24.1.0,1-1.8  2011-12-21 22:32:50  current

Symptoms

Data disks may be rendered offline after the disk firmware upgrade to 061A. This issue is not observable via the Software BUI or CLI.

Workaround

Note: The following workaround should only be performed if an update to the 2011.1.1.0 Software release has been completed. The workaround must be applied to ensure the storage pool replication characteristics are not degraded.

Depending on the configuration of your system, the following procedures are required to bring online any disks left offline by the firmware upgrade process:

Cluster Configuration:
After completing the instructions for a cluster update in the Online Help section (Maintenance:System:Updates), Head A (the first cluster head to be updated) should be rebooted. This can be accomplished by logging in to Head B and issuing a Takeover. Any offline disks on Head A will be automatically brought back online following the reboot. The cluster is now ready for normal operation. If you do not know which head performed the firmware upgrades, both heads will need to be rebooted. This can be accomplished by repeating the takeover step described above for both heads, one at a time.

7000:> configuration cluster takeover

Continuing will immediately take over the resources assigned to the cluster

peer. This may result in clients experiencing a slight delay in service.

Are you sure? (Y/N) Y

Standalone Configuration:
After all firmware upgrades have completed, the system should be rebooted to ensure that all disks are brought back online.

7000:> maintenance system reboot

This will reboot the appliance. Are you sure? (Y/N) Y

This issue is addressed in the following release:

• Sun ZFS Storage Appliance Software  2011.1.2.0 or later

Sun ZFS Storage Appliance Software information can be found in <Document:2021771.1>

Example screen capture of ZFS Storage Appliance (ZFSSA) Software GUI below:

History

26-Jan-2012: Date of Workaround release
24-Feb-2012: Maintenance update for minor clarifications
19-Mar-2012: Updated Resolution for new Software revision, issue is now resolved
13-Jul-2012: Maintenance update (Product attribution), no change in content
18-Sep-2013: Updated to correct Graphics format; no change in content



Oracle Service staff may use the zpool(1M) status command at the Solaris shell to determine if disks are offline after an update. If no disks are offline in a pool, then the workaround does not need to be applied. The following example shows a pool with offline disks:

7000# zpool status
pool: pool-20
state: DEGRADED
status: One or more devices has been taken offline by the administrator.
Sufficient replicas exist for the pool to continue functioning in a degraded state.
action: Online the device using 'zpool online' or replace the device with 'zpool replace'.
scan: resilvered 2K in 0h0m with 0 errors on Wed Jan 18 11:15:01 2012
config:
NAME                       STATE     READ WRITE CKSUM
pool-20                    DEGRADED     0     0     0
mirror-0                    DEGRADED     0     0     0
    c0t5000C500102CF92Bd0  ONLINE       0     0     0
    c0t5000C5001038A1A3d0  OFFLINE      0     0     0
mirror-1                 ONLINE       0     0     0
     c0t5000C5001038A20Fd0  ONLINE       0     0     0
     c0t5000C5001038A42Bd0  ONLINE       0     0     0
mirror-2                 DEGRADED     0     0     0
    c0t5000C5001038A167d0  OFFLINE      0     0     0
    c0t5000C5001038A683d0  ONLINE       0     0     0
mirror-3                 ONLINE       0     0     0
    c0t5000C5001038A773d0  ONLINE       0     0     0
    c0t5000C50010322E3Bd0  ONLINE       0     0     0
mirror-4                 DEGRADED     0     0     0
    c0t5000C50010325DB7d0  OFFLINE      0     0     0
    c0t5000C50010330E7Fd0  ONLINE       0     0     0
mirror-5                 DEGRADED     0     0     0
    c0t5000C50010366C77d0  OFFLINE      0     0     0
    c0t5000C50010366CAFd0  ONLINE       0     0     0
     ...

Please send technical questions to the following email:
sunalertpublication_us_grp@oracle.com
and copy the Responsible Engineer/Contributor listed below

Internal Contributor/Submitter: Christina.Coons@oracle.com
Internal Eng Responsible Engineer: Cynthia.McGuire@oracle.com
Internal Services Knowledge Engineer: david.mariotto@oracle.com
Internal Eng Business Unit Group: Systems Group - ZFS Storage Appliance
Internal Resolution Patches: N/A

References

This solution has no attachment