How to identify and interpret the LEDs on the Sun[TM] Netra CT900

Asset ID:	1-71-1019516.1
Update Date:	2017-10-06
Keywords:

Solution Type Technical Instruction Sure

Solution 1019516.1 : How to identify and interpret the LEDs on the Sun[TM] Netra CT900

Applies to:

Sun Netra CP3010 Blade Server - Version Not Applicable and later
Sun Netra CP3220 ATCA Blade Server - Version Not Applicable and later
Sun Netra CP3260 ATCA Blade Server - Version Not Applicable and later
Sun Netra CT900 Server - Version Not Applicable and later
All Platforms

Goal

Description

Observation of the LED status indicators can provide essential diagnostic information in the event of a problem occurring. This document will provide an explanation of the definition and function of the LEDs for each of the core FRUs of the Sun[TM] Netra CT 900. These being the Shelf Manager Modules (ShMM), the Switch Node Boards, the Shelf Alarm Panel (SAP), and the Power Entry Modules (PEM)

For the definition of the LEDs on each individual Server Node Board, refer to the relevant service manual in the customer documentation available at My Oracle Support (MOS)

Solution

Steps to Follow

Check all of the LEDs for unusual condition. Description of the meaning of
each of the LEDs is given below.

Shelf Management Module (ShMM)

For location of the LEDs refer to the attachment ShMM.gif at the bottom of this document

The LEDs on the ShMM fall into 3 categories

Ethernet LEDs
ShMM Status LEDs
Hot Swap LED

Ethernet LEDs

Name	Colour	Description
Ethernet 0 Link Speed	Yellow Green	This LED is normally Yellow to indicate that the connection to the switch is running at 100Mbps. If there is a problem across with the connection, the link may reduce speed to 10Mbps and the LED will turn Green. Ethernet port 0 on the ShMM is connected port 1 of the Base Network. The upper ShMM connect to the switch in slot 7, and the lower ShMM connects to the switch in slot 8.
Ethernet 0 Activity	Green	Any activity in the switch Base Network will cause this green LED to Blink.
Ethernet 1 Link Speed	Yellow Green	By default there is no connection to Ethernet 1 so the normal state of this LED is turned Off. If Jumper E1 on the CP3140 switch is connected between pins 1-2, port 17 on the base network is disconnected from the switch front panel but is instead routed Ethernet 1 on the ShMM across the mid-plane. The LED will then follow the same criteria as Ethernet 0.
Ethernet 1 Activity	Green	As with the Ethernet 1 Link Speed LED, the default for this LED is to be turned Off since there is no connection. If the jumper is made on the switch, this green LED will then Blink when there is network activity

Status LEDs

Name

Colour

Description

Lower Status LED

Green

This LED shows Solid Green to indicate that that the Shelf Management Module is operating as the Active ShMM.

If the ShMM is operating in the backup mode, the LED will Blink.

Upper Status LED

Red

When this LED shows solid RED it indicates "Out of Service" implying that the ShMM is currently not operational. If this occurs immediately after inserting the ShMM sheck whether the Lower status LED is lit, it may be necessary to press the reset button to

Note 1: If both ShMM have a Solid Green LED displayed, sometimes referred to as a 'Racing' condition, both ShMM are competing for the primary ShMM position. This has been observed with older firmware, but not since Release 3 of the ShMM firmware. One may attempt to pull one of the ShMMs to allow the other one to become Primary.

Note 2: If both ShMM are displaying Solid Red LEDs, this indicates that both ShMM are in a failed stated and under this condition you will not be able to connect to either of the ShMMs in question. Normally, one would examine the chassis or replace one of the ShMM to verify that we have actually a faulty ShMM. In this condition, the fan will spin up at full speed. And if it is not fixed in 15 minutes, the chassis will power itself down even if all other components are still functioning normally.

Hot Swap LED

LED State	ShMM Status	Description
Solid Blue	M1 FRU Inactive	The ShMM is ready to be removed. The bottom latch is open/not fully closed. In this condition you will not be able to make a connection to the ShMM.
Blinking (from solid)	M2 Activation Request	The IPMI micro-controller has requested permission to boot the payload from the shelf management controller. Boot up messages will be displayed via the serial connection.
Off	M3-M4 Active	This should be the state under normal operation. The IPMI micro-controller has received permission to boot the payload, and has done so.
Blinking (from off)	M5-M6 Deactivation Request	Opening the bottom latch activates this state. The IPMI micro-controller has requested permission to shut down the payload.

Shelf Alarm Panel

For location of the LEDs refer to the attachment SAP.gif at the bottom of this document

The Shelf Alarm Panel has 6 LEDs which may indicate a problem on the Shelf.

If the LED is lit, the condition is present.

If the LED is Blinking, the Alarm Silence Button has been pushed

If all Six LEDs are lit, there is no active ShMM

Alarm LEDs

LED Name	Colour	Description
Critical Telco Alarm	Red	An error or event that is detected by the system with a fatal impact to the system. In this case, the system/node can not continue to operate. Check LEDs and message files on all other boards
Major Telco Alarm	Red	An error or event that is detected by the system and has discernible impact to system operation. In this case, the system/node can continue to operate but in a "degraded" fashion (reduced performance or loss of non-fatal feature reduction). An example could be the loss of one of two mirrored disks. Check LEDs and message files on all other boards
Minor Telco Alarm	Amber	An error or event that is detected by the system but has little impact to actual system operation. An example would be a correctable ECC error. Check LEDs and message files on all other boards
User 1	Amber	Use of this LED is user defined and programmed. It does not necessarily indicate a hardware problem
User 2	Amber	Use of this LED is user defined and programmed. It does not necessarily indicate a hardware problem
User 3	Amber	Use of this LED is user defined and programmed. It does not necessarily indicate a hardware problem

Power Entry Module (and Fan Trays)

Fan Trays and PEMs have the same set of LEDs with similar definition. To simplify this document, only the PEM LEDs are detailed.

For location of the LEDs refer to the attachment PEM.gif at the bottom of this document.

PEM Status LEDs

LED Name	Colour	Description
OK Status	Green	Indicates the Power Entry Module is receiving power.
Failure Status	Red Amber	Indicates a failure of the PEM. It is safe to remove without pressing the hot swap button providing the other PEM is showing the OK LED. Early models have a Red LED. Newer model have an Amber LED.
Hot Swap	Blue	When Off, indicates PEM is active. Press the hot swap button to prepare for removal. When lit Solid Blue , The PEM is inactive, it is safe to remove the PEM after turning off external power. LED Blinks during transition from OFF to ON, and ON to OFF. If the LED remains flashing, examine the other PEM to determine if it is working properly and has power applied.

Netra CP3140 Switch Board

For location of the LEDs refer to the attachment cp3140_front_panel.gif at the bottom of this document.

The LEDs on the Netra CP3140 Switch board fall into 4 categories

Switch status LEDs
Hot swap LED
Port display select LEDs
Port link status and speed LEDs

Netra CP3140 Status LEDs

LED Name	Colour	Normal Operation	Description
OOS*	Red	Off	Out of service. This LED lights on a critical switch error.
Active	Green	On	This LED is lit when the switch OS is booted and switching
Minor*	Amber	Off	Minor Error/User Defined. This LED is software defined.

*The OOS and MINOR LEDs are both lit when the board is powered but not booted.

Netra CP3140 Hot Swap LED

LED State	Hot Swap Status	Description
Solid Blue	M1 FRU Inactive	The IPMI micro-controller is booted, but the switch OS is not. The bottom latch is open/not fully closed. This is the only state where it is safe to remove the board. In this condition you will not be able to make a connection to the Switch.
Blinking (from Solid)	M2 Activation Request	The IPMI micro-controller has requested permission to boot the switch OS from the ShMM. Boot up messages will be displayed via the serial connection.
Off	M3-M4 Active	This should be the state under normal operation. The IPMI micro-controller has received permission to boot the payload, and has done so.
Blinking (from Off)	M5-M6 Deactivation Request	The IPMI micro-controller has requested permission to shut down the Switch OS. Opening the bottom latch activates this state.

Netra CP3140 Network Display Select LEDs

Name	Description
3.0	When lit this LED indicates that the Base Network has been selected for display by the Switch Port Link Status LEDs as detailed below
3.1	When lit this LED indicates that the Extended (Fabric) Network has been selected for display by the Switch Port Status LEDs as detailed below

Note: Only one of these LEDs will be lit at any time.

Netra CP3140 Switch Port Link Status LEDs

Colour	Description
Orange	Indicates that the port has an active link running at 1000Mbps.
Green	Indicates that the port has an active link running at 100Mbps.
Yellow	Indicates that the port has an active link running at 10Mbps.
Off	Indicates that the link is not up.

These definitions apply to all 24 ports on the selected Network as shown by the Netra CP3140 Network Display Select LEDs

The shelf slots and switch ports are not directly mapped, instead each slot corresponds to a logical port on the switch.

Netra CP3140 Port Mapping

Switch Port	Slot 7 Base Network Connection	Slot 7 Extended Network Connection	Slot 8 Base Network Connection	Slot 8 Extended Network Connection
1	Upper ShMM eth0	Switch Slot 8	Lower ShMM eth0	Switch Slot 7
2	Switch Slot 8	Node Slot 6	Switch Slot 7	Node Slot 6
3	Node Slot 6	Node Slot 9	Node Slot 6	Node Slot 9
4	Node Slot 9	Node Slot 5	Node Slot 9	Node Slot 5
5	Node Slot 5	Node Slot 10	Node Slot 5	Node Slot 10
6	Node Slot 10	Node Slot 4	Node Slot 10	Node Slot 4
7	Node Slot 4	Node Slot 11	Node Slot 4	Node Slot 11
8	Node Slot 11	Node Slot 3	Node Slot 11	Node Slot 3
9	Node Slot 3	Node Slot 12	Node Slot 3	Node Slot 12
10	Node Slot 12	Node Slot 2	Node Slot 12	Node Slot 2
11	Node Slot 2	Node Slot 13	Node Slot 2	Node Slot 13
12	Node Slot 13	Node Slot 1	Node Slot 13	Node Slot 1
13	Node Slot 1	Node Slot 14	Node Slot 1	Node Slot 14
14	Node Slot 14	Not Used	Node Slot 14	Not Used
15	Not Used	Not Used	Not Used	Not Used
16	Not Used	Front Panel socket	Not Used	Front Panel socket
17	*Front Panel socket	RTM socket	*Front Panel socket	RTM socket
18	RTM socket	RTM socket	RTM socket	RTM socket
19	RTM socket	RTM socket	RTM socket	RTM socket
20	RTM socket	RTM socket	RTM socket	RTM socket
21	RTM socket	RTM socket	RTM socket	RTM socket
22	RTM socket	RTM socket	RTM socket	RTM socket
23	RTM socket	RTM socket	RTM socket	RTM socket
24	RTM socket	RTM socket	RTM socket	RTM socket

* By Default Port 17 on the Base Network is routed to the Switch Front Panel.
The User may enable Net-connect for ShMM Netconsole redundancy by installing jumper E1 on pins 1-2 of each of the Netra CP3140 Switch Boards. With this jumper installed, port 17 on the Base Network is routed through to ethernet 1 on the ShMM and the front panel socket is disabled. Switch Board 7 routes to the Upper ShMM, and Switch Board 8 routes to the lower ShMM.

Reading the LED state through the Shelf Management Module

In many cases it will not be possible to gain physical access to view the status LEDs. In these circumstances the clia getfruledstate command will provide additional scope for determining the status of the various components. To use this feature requires that you can connect to the ShMM via the network or serial port. If connection to one ShMM is not possible try the other one.

The syntax for using this will change slightly depending whether you wish to collect the information on all the FRUs or one FRU at a time. It may be necessary to run the clia fru command to identify the IPMI address to be used with the clia getfruledstate command.

Example 1: To interrogate the LED status for the Upper ShMM

#clia getfruledstate -v 10

10: FRU # 0, Led # 0 ("BLUE LED"):

Local Control LED State: LED OFF

LED's color capabilities:

Colors supported(0x02): BLUE

Default LED Color in Local Control State(0x01): BLUE

Default LED Color in Override State(0x01): BLUE

10: FRU # 0, Led # 4 ("Application Specific LED# 1"):

Local Control LED State: LED ON, color: GREEN

LED's color capabilities:

Colors supported(0x0C): RED GREEN

Default LED Color in Local Control State(0x03): GREEN

Default LED Color in Override State(0x03): GREEN

In this condition we observe Blue LED OFF and Green LED ON indicating a normal operational status, and that this is the Active ShMM.

Example 2: To interrogate the LED status for the Shelf Alarm Panel

# clia getfruledstate 20 8

20: FRU # 8, Led # 1 ("LED 1"):

Local Control LED State: LED OFF

20: FRU # 8, Led # 2 ("LED 2"):

Local Control LED State: LED ON

20: FRU # 8, Led # 3 ("LED 3"):

Local Control LED State: LED OFF

This shows the three Telco Alarm LEDs. In this example, the Major Telco Alarm LED is ON therefore further investigation of the other boards in the shelf will be required.

Product
Sun Netra CT 900 Server
Netra CP3010 Board
Netra CP3020 Board
Netra CP3060 Board
Sun Netra CP3140 ATCA Switch Blade
Sun Netra CP3220 ATCA Blade Server
Sun Netra CP3260 ATCA Blade Server
Netra CP3240 Switch

Attachments

This solution has no attachment