SPARC T5:S10 U11: SPT-8000-KQ :Identifying which Power Supply has a faulty fan in Solaris

Asset ID:	1-72-1620574.1
Update Date:	2017-10-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1620574.1 : SPARC T5:S10 U11: SPT-8000-KQ :Identifying which Power Supply has a faulty fan in Solaris

Applies to:

SPARC T5-2 - Version All Versions to All Versions [Release All Releases]
SPARC T5-4 - Version All Versions to All Versions [Release All Releases]
SPARC T5-8 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

SPARC T5 with Solaris 10 Update 11  FMA may report SPT-8000-KQ, a Power Supply
Fan failure. Solaris FMA will correctly report the event but it will not identify 
which PSU has has faulty fan.

 
STEP 1: more /etc/release
  
                   Oracle Solaris 10 1/13 s10s_u11wos_24a SPARC
  Copyright (c) 1983, 2013, Oracle and/or its affiliates. All rights reserved.
                            Assembled 17 January 2013

STEP 2: fmadm faulty

--------------- ------------------------------------  -------------- ---------
TIME            EVENT-ID                              MSG-ID         SEVERITY
--------------- ------------------------------------  -------------- ---------
Jan 16 20:39:04 2414500d-0c5b-e729-ec28-f76bd6f4847d  SPT-8000-KQ    Major     

Host        : -
Platform    : -	Chassis_id  : 
Product_sn  : 

Fault class : fault.chassis.power.fan-fail

Description : A fan inside of the Power Supply has failed.

Response    : The service required LED on the chassis and on the affected Power
              Supply may be illuminated.

Impact      : Reduced cooling may lead to temperature related faults and
              eventual system shutdown.

Action      : Please refer to the associated reference document at
              http://sun.com/msg/SPT-8000-KQ for the latest service procedures
              and policies regarding this diagnosis.


STEP 3: Solaris "prtdiag" will report all fan sensor TACH with ok


System Configuration:  Oracle Corporation  sun4v SPARC T5-2
Memory size: 261120 Megabytes

============================ Environmental Status ============================
Fan sensors:
----------------------------------------------------------------
Location                           Sensor             Status    
----------------------------------------------------------------
SYS/FANBD/F0                       TACH               ok
SYS/FANBD/F1                       TACH               ok
SYS/FANBD/F2                       TACH               ok
SYS/FANBD/F3                       TACH               ok
SYS/FANBD/F4                       TACH               ok
SYS/FANBD/F5                       TACH               ok




STEP 4: Solaris "prtdiag" will report LED State for PS_FAULT as steady

LEDs:
----------------------------------------------------------------
Location                           LED                State   
----------------------------------------------------------------
< removed some entries >
SYS                                MEMORY_FAULT       off     
SYS                                OK                 steady  
SYS                                PS_FAULT           steady <<<<<<<<<<

Cause

The ILOM Service Processor has identified the Fan fault, the event has been proxied to solaris FMA but the location of the faulty fan has not been relayed correctly. this issue is due to bug 16456603.

Solution

Bug 16456603 is fixed in Patch 146582-05

Patch 146582-05: SunOS 5.10: fmadm patch

If the patch has not been installed, the faulty PSU may be indentified using the following procedure.

From Solaris the faulty PSU can be determine with the Solris "prtpicl -v" command under
the  PSU fan fault Sensor (FANN_ERR).


Example of "prtpicl -v" output

In the example below PS0 is identified with a faulty fan

 < removed some entries from top >

             PS0 (power-supply, e50000530e)
              :FRU
              :ModelName	 7060596 
              :MfgName	 Power-One China,Gongming Town,Guangming District,518132 Shenzhen 
              :SerialNumber	 465776G+1311B302A2 
              :HW-version	 01 
              :Label	 PS0 
              :Description	 Power Supply FRU 
              :OperationalStatus	 enabled 
              :_class	 power-supply 
              :name	 PS0 
                 ERR (indicator, e500005319)
                  :Label	 ERR 
                  :Description	 Fault Sensor 
                  :Expected	 ok 
                  :Condition	 ok 
                  :OperationalStatus	 enabled 
                  :_class	 indicator 
                  :name	 ERR 
                 FAN_ERR (indicator, e500005321)
                  :Label	 FAN_ERR 
                  :Description	 Fault Sensor 
                  :Expected	 ok 
                  :Condition	 fail <<<<<<<<<<<<<<<<<<<<<<<< PS0 Fan has fail should be ok
                  :OperationalStatus	 enabled 
                  :_class	 indicator 
                  :name	 FAN_ERR 
 < removed some entries a the bottom >
  
"prtpicl -v" may be collected from explorer on the following file /<explorer directory>/sysconfig/prtpicl-v.out
    
  
Alternatively the status of the PSU fan can be collect from the ILOM with the following CLI

show -l all /System/Cooling/Fans location health -t

Attachments

This solution has no attachment