How to Replace a Sun Server X4-8, Oracle Server X5-8 CPU & Heatsink [VCAP]

Asset ID:	1-71-1926063.1
Update Date:	2018-05-15
Keywords:

Solution Type Technical Instruction Sure

Solution 1926063.1 : How to Replace a Sun Server X4-8, Oracle Server X5-8 CPU & Heatsink [VCAP]

Applies to:

Exadata X5-8 Hardware - Version All Versions to All Versions [Release All Releases]
Exadata X4-8 Hardware - Version All Versions to All Versions [Release All Releases]
Sun Server X4-8 - Version All Versions to All Versions [Release All Releases]
Oracle Server X5-8 - Version All Versions to All Versions [Release All Releases]
Exadata X6-8 Hardware - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Goal

How to Replace a Sun Server X4-8, Oracle Server X5-8 CPU & Heatsink.

Solution

DISPATCH INSTRUCTIONS

WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED?:
Sun Server X4-8, Oracle Server X5-8 Training

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 3

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW: A Sun Server X4-8, Oracle Server X5-8 CPU & Heatsink needs replacement

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY? :

This is a cold-service component. Disconnect the AC power cables from the server before performing this procedure.

Note: If this server is part of an Exadata, please follow shutdown instructions in DOC ID: 1982342.1

WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

NOTE:The CPUs are designated as CPU 0 on the individual CMODs, but they are designated the same number as the CMOD they reside on in ILOM.

How to Remove a CPU and Heatsink Assembly (FRU)

================================================
Caution - The CMOD is not a hot-swap component. Power off the system before removing.
================================================

1.Shutdown OS and power off server.

2.Remove the AC power cords for Cold service.

3.Identify which group of fan modules (left or right) to remove to access the CMOD. CMOD 0-3 (left fan group), CMOD 4-7 (right fan group).

4.Remove the 4 fan modules.

5.Remove the fan frame.

6.Identify the CMOD.

7.To unlock the CMOD, push down on the green labeled ejector handle latch release.

8.To disconnect the CMOD from the connector on the midplane, rotate the CMOD lever downward and away from the CMOD.

9.Use the lever to pull the CMOD partially out of its slot until you can grab it with both hands. Then pull it the rest of the way out of the server.

10.Rotate the lever inward until it's closed and latched.

================================================
Caution - To protect components from damage, always use an anti-static mat and wear a anti-static wrist strap.
================================================

How to Remove the Compute Module (CMOD) Cover

11.Press the cover release button on the top of the cover.

12.Slide the cover toward the back of the CMOD and lift the cover off the CMOD.

================================================
Caution - Component Damage - CMOD components are extremely sensitive to electro-static discharge. Wear a wrist strap and use an anti-static mat.
================================================

How to Remove a Heatsink and Processor (FRU)

13.Use the motherboard-mounted fault remind button to identify the CPU and heatsink assembly that you need to remove. You can verify the processor that has failed, by pressing the Fault Remind button and checking to see if the CPU fault indicator turns on. The button and indicator are part of the CMOD Fault Remind test circuit. The test circuit is powered by a time-limited charge. The charge allows you to use the circuit after the CMOD has been removed from the server. You must use the charge within 10 minutes of removing the CMOD from its power source; otherwise charge on the circuit dissipates, and the circuit becomes unusable. The circuit also has an indicator that allows you to verify the status of the charge.

14.Press down on the center of the heatsink and use a number 2 Phillips screwdriver to completely loosen the four spring-loaded screws. Pressing down on the heatsink relieves the pressure generated by the spring-loaded screws.

15.To separate the heatsink from the top of the processor, gently twist the heatsink left and right while it pulling upward. The twisting action helps to break the seal created by the thermal compound. A thermal compound that has been applied to the top of the CPU to facilitate the transfer of heat to the heatsink also acts as an adhesive.

16.Remove the heatsink from the CMOD, taking care that you do not allow the thermal compound to contaminate other components. A residual amount of compound remains on the bottom of the heatsink and on the top of the CPU. This compound must be removed before using the CPU replacement tool. An alcohol wipe is included with the replacement CPU.

17.Use the alcohol wipe to completely remove the thermal compound from the top of the CPU and the bottom of the heatsink, taking care that you do not allow the thermal compound to contaminate other components.

18.Open the spring-loaded CPU load plate release levers by pushing them down and moving them slightly toward the CPU socket and away from their retaining clips. The levers are numbered by their required order of operation.

19.Rotate the levers to their fully-open position. When the second lever is in its fully-open position, the load plate is unlocked and can be opened.

20.To open the load plate, lift the unhinged end to its fully-open position.

================================================
Caution - Component damage. The pins of the CPU socket can be easily damaged. Do not remove the CPU using your fingers. To remove the CPU, use the CPU replacement tool.
================================================

21.To remove the CPU, use the CPU replacement tool. The tool is used to remove and install the CPU in the socket. The top side of the replacement tool has a button in the center and a tab on one side. Pressing down on the button opens the tool. Pressing the tab closes the tool (and releases the button).

================================================
Note - Ensure that you use CPU replacement tool, part number 7080240. The part number is printed on the side of the tool. The tool is shipped with a new CPU.
================================================

A.Press down on the release button on top of the replacement tool. This action opens the tool. On one corner of the tool, there is a label with a downward pointing triangle. Likewise, the CPU is marked with a triangle on one of its corners. This is a key that aids in correctly positioning the tool and the CPU with the CPU socket. The tool and the CPU are correctly positioned with the socket when all of the triangles are aligned.

B.Orient the bottom of the tool over the CPU, ensuring that the triangle on the tool aligns with the triangle on the CPU.

C.Lower the tool onto the CPU, ensuring that it sits evenly on the CPU.

D.Push the release tab away from the center button. This action is accompanied by a click sound as the tool closes and grabs the CPU.

E.To remove the CPU, lift the tool upward and out of the server.

F.Turn the tool over, so the metal CPU contacts are facing upward and the topside of the tool is facing downward.

G.Hold the CPU by its edges.

H.On the topside of the tool (which is now facing downward), pull the release tab away from the center button. This action is accompanied by a click sound as the tool releases its hold on the CPU.

I.Remove the CPU from the tool.

22.Place the removed CPU on an anti-static mat.

How to Install a CPU and Heatsink Assembly (FRU)

23.At the CPU socket, ensure that the CPU load plate and both load plate release levers are in their fully open position.

24.To install a CPU, use the CPU replacement tool. The tool is used to remove and install the CPU in the socket. The top side of the replacement tool has a button in the center and a tab on one side. Pressing down on the button opens the tool. Pressing the tab releases the button and closes the tool.

B.Turn the replacement tool upside down, noting the corner of the tool that is marked with a triangle (alignment key).

C.Note the corner of the CPU that is marked with a triangle (alignment key).

D.Lift the CPU by its edges, taking care not to touch the metal contacts on the underside of the CPU.

E.Turn the CPU upside down (metal contacts facing upward) and set it on the replacement tool, ensuring that the triangle on the CPU aligns with the triangle on the tool and that the CPU sits flat in the tool. Do not release your hold the CPU. The CPU is not yet secured in the tool.

F.With the tool and the CPU in the topside down position, press the topside release tab outward, away from the center button. This action is accompanied by a click sound as the tool closes and grabs the CPU. The CPU should now be secured in the tool.

G.Ensure that the CPU is secured in the tool. When the CPU is secured in the tool, there is no side-to-side movement of the CPU within the tool.

25.Turn the tool over, so that the CPU contacts are facing downward. This positions the tool with the topside facing upward.

26.Orient the tool so that the triangle on the tool aligns with the triangle on the socket.

27.Lower the tool onto the socket, ensuring that the CPU is correctly positioned and sits flat and evenly in the socket. When the CPU is correctly positioned, there is no side-to-side movement of the CPU within the socket.

================================================
Caution - Possible component damage. The pins in the CPU socket can be easily damaged if touched or if the CPU is installed incorrectly.
Do not drop the CPU onto the socket. The CPU sits atop the socket and does not require insertion. Do not press down on the CPU.
================================================

28.To release the CPU from the tool, press the center button. This action is accompanied by a click sound as the tool opens and releases the CPU.

29.Remove the tool.

30.Inspect the CPU to ensure that it sits evenly within the socket.

31.Close the CPU load plate.

32.Lower and lock the right side lever, ensuring that the lever is secured under its retaining clip and that the bend in the lever locks the cover plate. The right side lever must be closed first.

33.Lower and lock the left side load plate lever, ensuring that it is secured under its retaining clip.

34.To apply the thermal compound, dispense the contents of the syringe as a single dollop in the center on the top of the CPU. Do not spread the thermal compound. The pressure applied during the heatsink installation performs this action.

================================================
Caution - Possible thermal-related component damage. To ensure the proper transfer of heat away from the surface of the CPU, apply the entire contents of the syringe.
================================================

35.To install the heatsink:

A.Align the captive spring-loaded heatsink screws with the threaded standoffs on the motherboard.

B.Set the heatsink on top of the CPU. Once the heatsink is in contact with the CPU, avoid extra movement of the heatsink.

================================================
Caution - System thermal failure or component damage. Once the bottom of the heatsink contacts the top of the CPU, do not move the heatsink.
Excessive heatsink movement can cause the thermal compound to smear and become uneven. This can result in voids in the compound that can negatively impact the transfer of heat away from the CPU.
================================================

C.Use a number 2 Phillips screwdriver and alternately tighten each screw one-half turn until all 4 screws are completely tightened.

36.Ensure that all tools and debris are removed from the CMOD.

How to Install the Compute Module (CMOD) Cover

37.Install the CMOD cover. To install the cover, position it over the CMOD chassis with the green button at the front.

38.Set the cover on the chassis, leaving a gap of approximately one inch (25 mm) between the lead edge of the cover and the front of the CMOD.

39.Ensure that the edges of the cover encapsulate the edges of the chassis, and that the pins in the cover are aligned with the slots in the chassis sidewall.

40.Slide the cover forward until it locks into place.

How to Install the Compute Module (CMOD)

41.Ensure that the CMOD lever is in the fully-open position.

A.Squeeze together the green tabs on the end of the lever.

B.Rotate the lever downward and away from the CMOD.

42.Position the CMOD in the slot.

43.On the front-facing side, ensure that the hinge for the lever is at the bottom.

44.Slide the CMOD into the slot until it stops. In this position, the pawl at the lever hinge is aligned with the slot in the server.

45.To install the CMOD, rotate the lever upward until it locks into place and is flush with the front of the CMOD. The action of rotating the lever upward draws the CMOD into the slot and engages the CMOD connector with the connector on the midplane.

================================================
Caution - Pinch point. When operating the lever, keep your fingers clear of the back side and hinged end of the lever.
================================================

46.Install the fan frame.

47.Install the four fan modules.

48.After removing a CMOD the DPCCs associated with the CMOD removed/reinserted must also be reseated to ensure they have not become slightly unseated.

49.Prepare the server for operation.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE CUSTOMER NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

How to verify the CPU is working properly.

Power on server and log into ILOM to confirm if the CPU is working properly.

1.Check CPU status from ILOM

1.1 show /SYS/CMODx/Px
note: the "x" means which CMOD and which CPU you replaced, both will be numbered the same

example

-> show /SYS/CMOD2/P2

    Properties:
        type = Host Processor
        ipmi_name = CMOD2/P2
        fru_description = Intel(R) Xeon(R) CPU E7-8895 v2 @ 2.80GHz
        fru_manufacturer = Intel
        fru_version = 000306E7 SR1NR
        fru_part_number = CM80636
        fault_state = OK
        clear_fault_action = (none)

1.2 Check if CMOD is working normal

example

-> show /SYS/CMOD2

    Properties:
        type = Blade
        ipmi_name = CMOD2
        fru_description = ASSY,CMOD SYS
        fru_manufacturer = MiTAC International Corporation
        fru_part_number = 7084469
        fru_rev_level = 03
        fru_serial_number = 489089M+14152T01A4
        fault_state = OK
        clear_fault_action = (none)

1.3 Check if there are any errors in the event log

example

-> show /SP/logs/event/list

1.4 Check ILOM FMA info for any errors

-> start /SP/faultmgmt/shell
Are you sure you want to start /SP/faultmgmt/shell (y/n)? y

example

fmadm faulty -a
STATE RESOURCE / UUID
-------- ----------------------------------------------------------------------

If faults exist, follow below doc and try to clear fault.

Doc ID 1381773.1
How to clear FMA logs on the ILOM or Solaris:ATR:1381773.1:1 (Doc ID 1381773.1)
https://support.us.oracle.com/oip/faces/secure/km/DocumentDisplay.jspx?id=1381773.1

2. Check if the CPU is working normal on the Operating System side.

Note: If this server is part of an Exadata, please follow start up instructions in DOC ID: 1982342.1

For Solaris:

2.1 use prtdiag -v command

example

# prtdiag -v
System Configuration: Sun Fire X4-8
BIOS Configuration: American Megatrends Inc. 29011300 08/26/2010
BMC Configuration: IPMI 2.0 (KCS: Keyboard Controller Style)

==== Processor Sockets ====================================

Version Location Tag
-------------------------------- --------------------------
Intel(R) Xeon(R) CPU E7-8895 v2 @ 2.8GHz CPU 1
Intel(R) Xeon(R) CPU E7-8895 v2 @ 2.8GHz CPU 2
Intel(R) Xeon(R) CPU E7-8895 v2 @ 2.8GHz CPU 3
Intel(R) Xeon(R) CPU E7-8895 v2 @ 2.8GHz CPU 4
.
.

2.2 Check if the CPU is online via psrinfo -v command

example

#psrinfo -v
Status of virtual processor 0 as of: 09/05/2011 09:37:34
on-line since 09/05/2011 09:35:14.
The i386 processor operates at 2800 MHz,
and has an i387 compatible floating point processor.
Status of virtual processor 1 as of: 09/05/2011 09:37:34
on-line since 09/05/2011 09:35:28.
The i386 processor operates at 2800 MHz,
and has an i387 compatible floating point processor.
Status of virtual processor 2 as of: 09/05/2011 09:37:34
on-line since 09/05/2011 09:35:28.
The i386 processor operates at 2800 MHz,
and has an i387 compatible floating point processor.
.
.

2.3 Check /var/adm/messages file for any errors

example

bash-3.00$ pwd
/var/adm

#grep -i warning messages
#grep -i error messages
#grep -i fail messages

PARTS NOTE:

REFERENCE INFORMATION:
Sun Server X4-8 Service Manual
https://docs.oracle.com/cd/E40591_01/html/E40317/index.html

Oracle Server X5-8 Service Manual
https://docs.oracle.com/cd/E56301_01/html/E56311/index.html

Sun Server X4-8 Compute Module (CMOD) Overview
https://docs.oracle.com/cd/E40591_01/html/E40317/gnsfn.html#scrolltoc

Sun Server X4-8 Processor Overview
https://docs.oracle.com/cd/E40591_01/html/E40317/gnsfn.html#XFESMgnsez

Sun Server CPU replacement video overview
https://docs.oracle.com/cd/E52420_01/videos/E52434/cpu_replace_generic/cpu_replace_generic.html

Otube video:
https://otube.oracle.com/media/How+to+Remove+and+Replace+a+CPU+on+an+Sun+Server+X4-8.mp4/0_w0nr8mgp

How to Shutdown and Startup Exadata X5 compute nodes and storage cells when performing hardware maintenance (includes Supercluster X5 storage cells) (Doc ID 1982342.1)

Attachments

This solution has no attachment