Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1525256.1
Update Date:2018-02-02
Keywords:

Solution Type  Technical Instruction Sure

Solution  1525256.1 :   How to Replace a SPARC T5-2 or SPARC T5-2 1S Motherboard  


Related Items
  • SPARC T5-2
  •  
Related Categories
  • PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: SPARC-CAP VCAP
  •  




In this Document
Goal
Solution
References


Oracle Confidential PARTNER - Available to partners (SUN).
Reason: FRU CAP

Applies to:

SPARC T5-2 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Goal

How to Replace a SPARC T5-2 or SPARC T5-2 1S Motherboard

********************************************************************************
To report errors or request improvements on this procedure,
please go to http://support.us.oracle.com and put a comment on Doc ID: 1525256.1
********************************************************************************

Solution

DISPATCH INSTRUCTIONS

WHAT SKILLS DOES THE FIELD ENGINEER /ADMINISTRATOR NEED:(IS A SITE ENGINEER AVAILABLE?)
SPARC T5-2 Server product training.

TIME ESTIMATE: 240 minutes

TASK COMPLEXITY: 1

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS

PROBLEM OVERVIEW: SPARC T5-2 Server or SPARC T5-2 1S Motherboard replacement.

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY? :

ESD Caution:

  • Circuit boards and drives contain electronic components that are extremely sensitive to static electricity. Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards. Do not touch the components along their connector edges.
  • Use a Antistatic Wrist strap. Attach one end of the strap to your wrist and the other end to the chassis, depending on what type of strap you use, with the adhesive end or the metal plug.
  • Use an Antistatic Mat. Place ESD-sensitive components such as motherboards, memory, and other PCBs on an antistatic mat
DAMAGE ALERT: Perform a visual inspection of the replacement part to make sure that there are no damaged components, connectors, bent pins, damaged packages during shipping, etc. If the part is damaged, don't install it into the system, order a new part. Handle with caution and package carefully the return part to avoid any damages during shipping.


1. Prepare for servicing:
a. Attach an antistatic wrist strap.
b. Power off the server and unplug power cords from the power supplies.
c. Extend the server to maintenance position.
d. Remove the top cover.

NOTE: Refer to Doc ID 2262283.1, for details on how verify or upgrade the CPUMFPGA version after MB replacement. If all the CPUMFPGA Versions are at 12.3.7.3 or higher, you don't need to install the FPGA HW programmables (1.0.11). If not, follow the procedure in doc 2262283.1 to install SysFW 9.6.20.b first (patch 27043436), then the FPGA HW programmables (patch 25796761). It is required to have the same FPGA version 12.3.7.3 or later on all CPUs (system). SysFW 9.6.20.b is required for the FPGA HW programmables to be active and to resolve some power glitch issues - see alert 2353691.1 for details.
NOTE: The LDOM configuration (if any) needs to be saved before motherboard replacement to avoid loss of LDOM configuration, refer to doc 1019720.1 for details.

WHAT ACTION DOES THE FIELD ENGINEER/ ADMINISTRATOR NEED TO TAKE:

DAMAGE ALERT 1: Please follow the attached instructions (P/N 7064682) when packaging the T5-2 motherboard. These packaging instructions must be followed precisely to prevent the T5-2 motherboard from getting damaged during shipping.

DAMAGE ALERT 2: You MUST remove the transceivers when removing or replacing the PCI card at slot 7. Make sure the pci bracket/card makes no contact with the MB. MB component damage can occur reference Docid 1526065.1.

Removing the MotherBoard

1. Remove all PCIe cards.
2. Remove the SP (Service Processor) and System Configuration PROM from the motherboard so you can reinstall it on the new motherboard.

NOTE: The SP contains the Oracle ILOM system configuration data, and the System Configuration PROM contains the system host ID and MAC address. Transferring these components preserves the system-specific information stored on these modules. Whenever you replace the motherboard or the SP, you must update the firmware so the portions of firmware in the SP and on the motherboard are consistent.

3. Remove all memory risers (8 for a SPARC T5-2 server or just 4 for a SPARC T5-2 1S server).

4. (This step is for 1-processor motherboards only), remove the airflow baffle and the mylar memory riser connector cover from the empty side of the center bracket.
NOTE: Save both to install on the new 1-processor motherboard.
    a. On the processor side of the center bracket, lift the airflow baffle's hooks away from the edge of the center bracket.
    b. Lift the airflow baffle away from the motherboard.
5. Remove the System Remind button assembly (air divider) by lifting it up and away from the power supplies.
6. Disconnect all cables connected to the motherboard by completing the following tasks:
    a. Disconnect two longer cables that connect the motherboard to the hard disk drive backplane (Push down a metal tab on each connector and pull up).
    b. Disconnect three shorter cables from the motherboard (Two cables go to the drive backplane. The other is a ribbon cable to the power supply).
    c. Disconnect the fan board power cable and the ribbon cable from the motherboard.
7. Remove the power supply cover (Remove scew from side of the power supply and ribbon cable to make removing the cover easier. There are two slots on the power supply backplane cover that you must guide around pins on the inside of the power supply cage).
    a. Lift the cover up a little to clear the first part of the slots.
    b. Push the cover a little towards the front of the chassis.
    c. Push the tooth at the bottom of the cover to clear the edge of the power supply cage.
    d. Lift the cover out of the chassis (Notice the two cables that are now exposed. Be prepared to move those cables out of the way when you lift the motherboard).
8. Remove the four bus bar screws securing the motherboard to the power supply backplane.
9. Position the HDD end of the cables off to the side using the tab on the top of the plastic power supply cover.
10. Remove the motherboard by completing the following tasks:
    a. Loosen the captive screw in the corner near the fans that secures the motherboard to the chassis.
    b. Grasp the handle on the motherboard and slide it toward the front of the chassis (Tilt up the end of the motherboard that is near the front of the chassis).
    c. Lift the motherboard out of the chassis (Ensure that remaining cables do not get caught on edges of the motherboard).

Installing the Motherboard

1. Unpack the replacement motherboard and place it on an antistatic mat.
Note: On the 1-processor motherboard only, do not remove the protective covering on the unused processor and memory riser areas.
2. On the replacement motherboard, install the service processor (SP) and System Configuration PROM that you removed from the old motherboard.
3. Grasping the motherboard by the handle, place it into the chassis (Ensure that remaining cables do not get caught on edges of the motherboard. Set the motherboard towards the front of the chassis, then slide it toward the rear of the chassis).
4. Tighten the captive screw (in the corner near the fans) that secures the motherboard to the chassis.
5. Reinsert and tighten the four bus bar screws that secure the motherboard to the power supply backplane.

Note: Using a No. 2 screwdriver, tighten the bus bar screws until the power supply backplane and the motherboard securely fasten to the bus bars.

6. Replace the power supply backplane cover.
    a. Align the power supply backplane cover (Ensure that the tooth at the bottom of the cover is clear of the power supply cage. There are two slots on the power supply backplane cover that you must guide around pins on the inside of the power supply cage).
    b. Fit the two slots on the cover around the two pins.
    c. Lift up the cover a little to guide the two pins into the other part of the slots.
    d. Attach the screw to fasten the power supply backplane cover in place.
7. Push the power supplies back into place.
8. Reattach all cables to the motherboard.
    a. In the center rear of the motherboard, connect the fan board power cable and the ribbon cable to the motherboard.
    b. Near the drives, connect two shorter cables to the motherboard. One cable goes to the drive backplane. The other is a ribbon cable to the power supply.
    c. Near the drives connect two longer cables between the motherboard and the drive backplane.
9. Reinstall the System Remind button assembly (air divider) by sliding it into the chassis.

Caution: After replacing the motherboard, inspect the dividing wall gasket, and then install the plastic dividing wall securely. This dividing wall maintains a pressurized seal between the server cooling zones. Without this pressurized seal, the power supply fans will not be able to draw enough air to cool the drives properly.

10. (This step is for 1-processor motherboards only), On a 1-processor motherboard, attach the airflow baffle to the empty side of the center bracket.

Note: Use the airflow baffle that you saved from the old 1-processor motherboard.

     a. On the memory riser side of the center bracket, align the airflow baffle over the four unused slots.
         The four hoops on the airflow baffle face away from the center bracket.
     b. Set the lower guide in the corner of the outer unused slots.
     c. Press each of the four hoops until the airflow baffle's hooks snap firmly into place.
     d. Verify that the airflow baffle is securely attached to the center bracket.
     e. Remove the mylar memory riser slots protective cover (covering the four unused memory riser slot connectors on the bad 1-processor motherboard) and install it over the four empty memory riser slots on the new 1-processor motherboard.
11. Reinstall all memory risers (8 for a SPARC T5-2 server or just 4 for a SPARC T5-2 1S server).
12. Reconnect all cables from the power supply backplane, drive backplane, and fan board to their original locations on the motherboard.
13. Reinstall all PCIe cards.
14. Install the top cover.
15. Return the server to the normal rack position.
16. Reinstall the power cords to the power supplies.
17. Prior to powering on the server, connect a terminal or a terminal emulator (PC or workstation) to the service processor SER MGT port.

If the service processor detects the host firmware on the replacement motherboard is not compatible with the existing service processor firmware, further action will be suspended and the following message will be displayed:

Unrecognized Chassis: This module is installed in an unknown or unsupported chassis. You must upgrade the firmware to a newer version that supports this chassis.

If you see the preceding message, continue to Step 18. Otherwise, skip to Step 19.

18. Download the system firmware.
a. If necessary, configure the service processor NET MGT port so that it can access the network.
b. Log in to the service processor through the NET MGT port.
c. Download the system firmware. Follow the firmware download instructions in the Oracle ILOM documentation. You can load any supported system firmware version, including the firmware version that had been installed prior to replacing the motherboard.

NOTE: In case the FW upgrade via ILOM BUI fails, please use the CLI method (see example in doc 2019500.1). You may need a source of TFTP in order to upgrade firmware via CLI commands, for details refer to: Solaris[TM] Operating System: How to set-up a TFTP server. (Doc ID 1004474.1). See also doc 2076315.1 in References.

ALERT: In some rare cases when updating the SysFW via CLI (and during CLI execution), it may fail with the following error:

Hostname: <your hostname>

-> load -source tftp://xxx.xxx.xxx.xxx/Sun_System_Firmware-9_4_2_e-SPARC_T5-4+T5-8.pkg
Cannot read power state

load: Command Failed

If that happens, use the below steps (confirmed by FSEs to be a successful workaround in resolving the issue):

- Returning original part
- Install the last firmware with the old part
- Install again the new part
- Try to re-flash the last firmware

NOTE: part could be either MM, MB or SP

This failure is due to bug 24804437, it is just filed to get engineering attention and assist us in determining the technical issue or perhaps provide an alternative/appropriate solution.

Please add a defect to bug 24804437 in your SR.

NOTE: Re-activate any RAID volumes that existed prior to replacing the motherboard. Only perform this task if your system had RAID volumes prior to replacing the motherboard. For details refer to doc 1387771.1 and the SPARC T5-2 Service Manual.

 

19. Set ILOM date/time  (-> set /SP/clock datetime=MMDDhhmmYYYY.ss)

20. Power on the server. Verify the motherboard functionality.

DAMAGE ALERT: Please follow the attached instructions (P/N 7084394) when packaging the T5-2 motherboard. These packaging instructions must be followed precisely to prevent the T5-2 motherboard from getting damaged during shipping.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE FE/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:
Boot system and monitor boot sequence for errors. Test functionality of system:
1. Run the Solaris "fmadm faulty" and SP/ILOM "show disabled" and "show faulty" command (if only ALOM is supported run "showfaults -v" command) to verify that the fault has been cleared.
2. Perform one of the following tasks based on your verification results:
   * If the previous steps did not clear the fault, refer to doc 1004229.1 for information about the tools and methods you can use to diagnose and clear
     component faults.
   * If the previous steps indicate that no faults have been detected, the component has been replaced successfully. No further action is required
3. Restart software applications per applicable administration guides to resume system operation.


PARTS NOTE:

https://support.oracle.com/handbook_partner/Systems/SPARC_T5_2/components.html

 

REFERENCE INFORMATION:

SPARC T5-2 Service Manual
http://docs.oracle.com/cd/E28853_01/html/E28856/index.html


Oracle Integrated Lights Out Manager 3.2 Documentation
http://docs.oracle.com/cd/E37444_01/

References

<NOTE:2076315.1> - Where to Find and How to use TFTP and ILOM CLI To Upgrade Firmware on T3, T4, T5, and T7 Systems when BUI Fails

Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback