Sun Storage 7000 Unified Storage System: Solaris Fault Manager received an event FMD-8000-0W (after DIMM failure)

Asset ID:	1-72-1560814.1
Update Date:	2013-08-30
Keywords:

Solution Type Problem Resolution Sure

Solution 1560814.1 : Sun Storage 7000 Unified Storage System: Solaris Fault Manager received an event FMD-8000-0W (after DIMM failure)

Applies to:

Sun Storage 7410 Unified Storage System - Version All Versions and later
Sun ZFS Storage 7120 - Version All Versions and later
Sun ZFS Storage 7420 - Version All Versions and later
Sun ZFS Storage 7320 - Version All Versions and later
Sun Storage 7310 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)

Symptoms

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance

The customer received an ASR alert that showed the fault manager (FMD) had an event that it was unable to process:

--------------- -------------------------------------------------------------- -------------- ---------
TIME              EVENT-ID                                 MSG-ID              SEVERITY
--------------- -------------------------------------------------------------- -------------- ---------
Jun 11 04:59:01 f7e48b0e-572d-cdb6-ddaf-b7fcee267d80        FMD-8000-0W    Minor

Host        : NAS-1
Platform    : SUN-FIRE-X4470-M2-SERVER Chassis_id : 1234ABC12Z
Product_sn :

Fault class : defect.sunos.fmd.nosub
FRU         : None
                  faulty

Description : The Solaris Fault Manager received an event from a component to
              which no automated diagnosis software is currently subscribed.
              Refer to http://sun.com/msg/FMD-8000-0W for more information.

Response    : Error reports from the component will be logged for examination by Sun.

Impact      : Automated diagnosis and response for these events will not occur.

Action      : Run pkgchk -n SUNWfmd to ensure that fault management software is
              installed properly. Contact Sun for support.

Changes

None

Cause

If there has been a DIMM failure with an event SENSOR-8000-AM - then a secondary event of FMD-8000-OW can be generated several days later - if there has been a delay in replacing the faulty component.

For example - this is the related Alert for the appliance NAS-1 that had a DIMM failure:

chassis-000 NAS-1 faulted Oracle Sun ZFS Storage 7420

memory-013 P0/MR1 DIMM 5 faulted HYNIX SEMICONDUCTOR INC. 8GB DDR3 SDRAM 666 48CD172F

But then also saw this alert opened before the faulty component (a DIMM) was replaced.

--------------- ------------------------------------------------------------- --------------            ---------
TIME            EVENT-ID                                          MSG-ID                SEVERITY
--------------- ------------------------------------------------------------- --------------          ---------
May 26 17:01:55 ba8b7dfd-5847-e7c9-ddea-b4a45757228b SENSOR-8000-AM   Major

Host        : NAS-1
Platform    : SUN-FIRE-X4470-M2-SERVER Chassis_id : 1234ABC12Z
Product_sn :

Fault class : fault.memory.intel.dimm.indicator-set

Affects     : hc://:product-id=SUN-FIRE-X4470-M2-SERVER:product-sn=xxxxxxxxx:server-id=NAS-1:chassis-id=xxxxxxxxx:serial=48CD172F:part=HMT31GR7BFR4A -H9/motherboard=0/chip=0/memory-controller=1/dram-channel=3/dimm=1
                  faulted but still in service
Problem in : "P0/MR1 DIMM 5" (hc://:product-id=SUN-FIRE-X4470-M2-SERVER:product-sn=xxxxxxxxx:server-id=NAS-1:chassis-id=xxxxxxxxx:serial=48CD172F:part=HMT31GR7BFR4A-H9/motherboard=0/chip=0/memory-controller=1/dram-channel=3/dimm=1)
                  faulted but still in service
FRU         : "P0/MR1 DIMM 5" (hc://:product-id=SUN-FIRE-X4470-M2-SERVER:product-sn=xxxxxxxxx:server-id=NAS-1:chassis-id=xxxxxxxxx:serial=48CD172F:part=HMT31GR7BFR4A-H9/motherboard=0/chip=0/memory-controller=1/dram-channel=3/dimm=1)
                  faulty

Description : A sensor indicates that the memory module 'P0/MR1 DIMM 5' has
              been diagnosed as faulty by the Service Processor. Refer to
              http://sun.com/msg/SENSOR-8000-AM for more information.

Response    : None.

Impact      : The system may have been reset.

Then this event code FMD-8000-0W was received.

"Solaris Fault Manager received an event from a component to which no automated diagnosis software is currently subscribed."

Solution

The event FMD-8000-0W will not cause any impact on the ZFS storage.

To confirm the cause:

Open the appliance BUI and access the Maintenance > Problems page to confirm if a related DIMM event was generated.

Also the Maintenance > hardware will show an amber icon against the head unit - and the failed component.

If yes - an ASR will have been sent to Oracle to open a Service Request to have the component replaced.

Confirm the MOS SR is open and that the supportbundle has been provided.

To provide a support bundle follow the instructions in this document:

1019887.1 - Sun Storage 7000 Unified Storage System: How to collect a supportbundle using the BUI or CLI

Once the DIMM has been replaced, both FMD events SENSOR-8000-AM and FMD-8000-OW can be 'markrepaired' on the Maintenance Problems page.

References

<NOTE:1324432.1> - Sun Storage 7000 Unified Storage System: 7xx0 Memory Troubleshooting
<NOTE:1278341.1> - Sun ZFS Storage Appliance: How to determine the DIMM CRU used in a 7210 or 7320 NAS.
<NOTE:1019887.1> - Sun Storage 7000 Unified Storage System: How to collect a supportbundle using the BUI or CLI

Attachments

This solution has no attachment