Exadata X7-2 Hardware
 
Oracle SuperCluster M8 Hardware
 
Exadata X7-8 Hardware
 
Zero Data Loss Recovery Appliance X7 Hardware
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
 

In this Document

Goal

Solution

References

Oracle Confidential PARTNER - Available to partners (SUN).
Reason: Exadata internal only for Oracle support engineers use and approved HW partners

Applies to:

Goal

How to Replace an Exadata X7-2 Storage Cell Server CPU.

Solution

DISPATCH INSTRUCTIONS:

WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED?: Exadata X7-2 Training

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 3

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW:  An Exadata X7-2 Storage Cell Server CPU needs replacement

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:

IMPORTANT NOTE TO TSC ENGINEER:  CUT & PASTE the “CUSTOMER ACTIVITY” sections of the Pre-Replacement and Post-Replacement steps into a SR Note and ensure the customer is aware to do these steps prior to the scheduled field engineer activity, and during and after the replacement activity.

CUSTOMER ACTIVITY:

Shutdown of the storage cell is required prior to the part replacement:

Complete Steps 1 to 6 of Note ID 1188080.1 “Steps to shut down or reboot an Exadata storage cell without affecting ASM”.

Where noted, the SQL, CellCLI and commands under ‘root’ should be run by the Customers DBA, unless the Customer provides login access to the Field Engineer

These steps are also provided in the documentation:
   https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE?:

Prepare the Server for Service

The customer should have already prepared the server and powered it off.  If not, provide them the instructions in the previous section.

1. Extend the server to the maintenance position
2. Disconnect the power cords from the power supplies.
3. Attach an anti-static wrist strap to your wrist and to a metal area on the chassis or the rack.
4. Remove the server top cover. Use a Torx T10 screwdriver to unlock the release button latch.

Removing the Faulted CPU

1. Open the latch on the SuperCap tray and swing it up from the air baffle.

2. Lift up and remove the air baffle.

3. Identify the location of the faulty processor by pressing the Fault Remind button on the motherboard. The Fault Remind button is blue and located in the middle of the motherboard, near the handle and entrance to the center cable routing channel. The processor fault LED for the faulty processor lights. The processor fault LEDs are located next to the processors. If the processor fault LED is off, then the processor is operating properly. If the processor fault LED is on (amber), then the processor is faulty and must be replaced.

4. Using a 12.0 in-lbs Torx T30 driver (part number 7352217), loosen the four captive nuts that secure the processor/heatsink module to the socket: fully loosen nut 4, then 3, then 2, then 1.

5. Lift the processor/heatsink module from the socket.  Always hold the processor -heatsink module along the ends of the fins to prevent damage, not the flat sides.

6. Separate the processor from the heatsink:

a. Flip over the processor/heatsink module, place it on a flat surface, and locate the thermal interface material (TIM) breaker slot.

b. While holding down the processor/heatsink module by the edges, insert a flat blade screwdriver into the TIM breaker slot.  The blade of the screwdriver goes into the slot between the heatsink and processor carrier, not between the processor and processor carrier.

c. Using a rocking motion, gently pry the corner of the processor carrier away from the heatsink.

d. Remove the processor carrier with processor from the heatsink by prying or pinching the plastic latch tabs that attach the processor to the heatsink.

7. If you plan on reusing either the heatsink or processor, use an alcohol pad to clean the thermal grease on the underside of the heatsink and on the top of the processor.

Installing the Replacement CPU

1. Unpack the replacement processor but do not remove it from the packaging tray.

2. Ensure that the replacement processor is identical to the failed processor that was removed.

3. Use the syringe supplied with the new or replacement processor to apply 0.3 cc of thermal interface material (TIM) in an "X" pattern to the processor contact area of the heatsink.

4. Install the new processor:

a. Align the pin 1 indicators between the heatsink and processor carrier in the packaging tray, and place the heatsink (thermal side down) onto the processor carrier until it snaps in place and lies flat. 

b. Lift the processor-heatsink module out of the packaging tray.

c. Align the processor-heatsink module to the processor socket bolster plate on the motherboard, matching the pin 1 location (a triangle indicator).

d. Place the processor-heatsink module on the socket on the motherboard.  The socket bolster plate has alignment pins that go into holes on the processor-heatsink module to help center the module during installation.

e. Ensure that the processor-heatsink module lies evenly on the bolster plate and that the captive screws align with the threaded socket posts.

f. Using a 12.0 in-lbs (inch-pounds) torque driver (part number 7352217) with a Torx T30 bit, tighten the processor-heatsink module to the socket. First, fully tighten captive nuts 1 and 2. Then fully tighten nuts 3 and 4.  As you tighten nuts 3 and 4, some resistance occurs as the bolster leaf spring rises and comes in contact with the heatsink.

5. Lower the air baffle back into place over the DIMMs and CPU's.

6. Lower and clip the SuperCAP tray back into the air baffle.

Return the Server to Operation

1. Install the server top cover. Use a Torx T10 screwdriver to lock the release button latch.
2. Reconnect the power cords to the server power supply and connect any other cables to their original locations.
3. Return the server to the normal rack position.
4. Once the power cords have been re-attached and the ILOM has booted you will see a slow blink on the green LED for the server. Power on the
server by pressing the power button on the front of the unit.
5. Connect to the server console via the ILOM and monitor the boot.
      By default the ILOM serial console displays the primary console output.
      In the event of unexpected boot behavior, it is advisable to connect to both ILOM serial and ILOM graphics consoles at the same time and monitor.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE?:

FIELD SERVICE ENGINEER and CUSTOMER ACTIVITY:

1. Verify all expected hardware is visible to the server and the fault is cleared. Assistance from the customer for server login access will be required.

2. Verify there are no outstanding faults in ILOM:

If ILOM is still showing the CPU as faulted, then manually clear the CPU fault as follows:

a. login to the ILOM CLI and launch a Fault Management Shell session

b. use the "fmadm faulty -a" command to list out all active faulty components

c. If the CPU that was just replaced is still listed as a fault then indicate that the CPU has been replaced by using the command "fmadm replaced <fru|cru|uuid>" for example:

d. confirm that the faults are cleared and then exit out of the fault management shell
  

3. Verify there are no outstanding alerts in the Cell:

4. Re-activate the Storage Cell grid disks.  Follow Steps 7 to 10 of Note ID 1188080.1 “Steps to shut down or reboot an Exadata storage cell without affecting ASM”.

Where noted, the SQL, CellCLI and commands under ‘root’ should be run by the Customers DBA, unless the Customer provides login access to the Field Engineer.

These steps are also provided in the documentation:
   https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

PARTS NOTE:

7347511 [F] 10-Core 2.2GHz Xeon S-4114, 85W, SR3GK
7322160 [F] Pre-Greased 2U CPU Heatsink
7352217 [F] 12 in/lb Torque Driver

 

REFERENCE INFORMATION:

Oracle Exadata Database Machine Maintenance Guide: https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

Oracle Server X7-2L Documentation:  https://docs.oracle.com/cd/E72463_01/index.html

X7-2L CPU Removal and Replacement Procedure: https://docs.oracle.com/cd/E72463_01/html/E72474/gqtmk.html#scrolltoc

Steps to shut down or reboot an Exadata storage cell without affecting ASM (Doc ID 1188080.1)

This solution has no attachment