How to Replace an Exalogic Elastic Cloud Compute Node X6-2 PCIe Card

Asset ID:	1-71-2311420.1
Update Date:	2018-01-25
Keywords:

Solution Type Technical Instruction Sure

Solution 2311420.1 : How to Replace an Exalogic Elastic Cloud Compute Node X6-2 PCIe Card

Applies to:

Exalogic Elastic Cloud X6-2 Hardware - Version X6 and later
Information in this document applies to any platform.

Goal

How to Replace an Exalogic Elastic Cloud X6-2 PCIe card

If you are replacing the Infiniband HCA, please refer to MOS Note: How to Replace a Failed InfiniBand (HCA) Card on a Exalogic Compute Node(Doc ID 1390273.1)

Solution

CAP PROBLEM OVERVIEW: PCIe Card Replacement

DISPATCH INSTRUCTIONS

WHAT SKILLS DOES THE ENGINEER NEED:
Exalogic X6-2 Training.

TIME ESTIMATE: 30 minutes

TASK COMPLEXITY: 1-FRU

FIELD ENGINEER INSTRUCTIONS

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY? :

If the system is still up and functioning, customer should perform an orderly and graceful shutdown of applications and OS. Then power off the server and remove the AC power cords from the system.

A data backup is not a prerequisite but is a wise precaution.

Note: If this is an Exalogic server running OVS with virtual servers, please verify customer has readied the server by moving VM's off of the server and placed the server in maintenance mode. See Document: Making an OVS Node Unavailable for vServer Placement in Exalogic Virtual Environments using EMOC (Doc ID 1551724.1)

WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

PCIe Slot Characteristics:

There are three external and one internal PCIe slots available in the Oracle Server X6-2. The external slots support optional, standard PCIe cards and are numbered 1, 2, and 3 from left to right when you view the server from the rear. The internal slot, which installs on the riser in PCIe slots 3 and 4, supports a required internal SAS controller HBA card.

Note: PCIe slot 1 is nonfunctional in single-processor systems.

Remove a PCIe Card From PCIe Slot 1 or 2:

1. Power off the server and disconnect the power cords from the power supplies.

2. Extend the server to the maintenance position

3. Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis.

4. Remove the server top cover

5. Select the PCIe riser that you want to remove

6. Disconnect any external cables from the card.

7. Lift the green-tabbed latch on the rear of the server chassis next to the applicable PCIe slot to release the rear bracket on the PCIe card

8. Lift the green-tabbed riser release lever on the PCIe riser with one hand and use your other hand to remove the riser from the motherboard connector

9. Remove the PCIe card from the PCIe riser.

Hold the riser in one hand and use your other hand to carefully pull the PCIe card connector out of the riser
Disconnect the rear bracket that is attached to the PCIe card from the rear of the PCIe riser

10. Place the PCIe card on an antistatic mat

Install a PCIe Card in PCIe Slot 1 or 2:

1. Retrieve the PCIe card and riser you want to install

2. Insert the rear bracket that is attached to the PCIe card into the PCIe riser.

3. Hold the riser in one hand and use your other hand to carefully insert the PCIe card connector into the Riser

4. Raise the green-tabbed release lever on the PCIe riser to the open (up) position

5. Gently press the riser into the motherboard connector until it is seated, and then press the green-tabbed release lever on the PCIe riser to the closed (down) position

6. Close the green-tabbed latch on the rear of the server chassis next to the applicable PCIe slot to secure the rear bracket on the PCIe card to the server chassis

7. If there were any external cables connected to the PCIe card, reconnect them

Remove a PCIe Card From PCIe Slot 3:

Note - This PCIe riser is actually installed in PCIe slot 3, but it supports up to two PCIe cards. The upper slot, referred to as slot 3, can be used for any supported PCIe card, and, therefore, is optionally populated. The lower slot, referred to as slot 4, is dedicated to the internal HBA card, and, therefore is always populated.

1. Power off the server and disconnect the power cords from the power supplies

2. Extend the server to the maintenance position

3. Attach an antistatic wrist strap to your wrist and then to a metal area on the chassis

4. Remove the server top cover.

5. Disconnect any external cables from the card.

Note - Do not disconnect the SAS cable from the internal host bus adapter card until after you have removed the riser from the server.

6. Open the green-tabbed latch located on the rear of the server chassis next to PCIe slot 3 to release the rear bracket on the PCIe card

7. To release the riser from the motherboard connector, lift the green-tabbed release lever on the PCIe riser to the open position

8. Slide the plastic PCIe card retainer, which is mounted on the side of the chassis, toward the front of the server to release the card(s) installed in the riser

9. Grasp the riser with both hands and remove it from the server

10. Disconnect the SAS storage drive (HDD) cables from the internal HBA card installed in PCIe slot 4

11. Disconnect the super capacitor cable from the internal HBA card in slot 4

12. Remove the PCIe card from the riser:

Hold the riser in one hand and use your other hand to carefully remove the PCIe card connector from the riser.
Disconnect the rear bracket attached to the PCIe card from the rear of the PCIe riser

13. Place the PCIe card and riser on an antistatic mat

Install a PCIe Card in PCIe Slot 3:

1. Retrieve the PCIe card and riser you want to install.

2. Insert the rear bracket that is attached to the PCIe card into the PCIe riser.

3. Hold the riser in one hand and use your other hand to carefully insert the PCIe card connector into the riser.

4. Reconnect the SAS cables to the internal host bus adapter card. Be sure to connect the SAS cable for storage drives 0 through 3 (HDDs 0-3) to the connector that is farthest from the riser in which the HBA card is installed; otherwise, the server will incorrectly identify the storage drives when it is powered on.

5. Reconnect the super capacitor cable to the internal HBA card in slot 4.

6. Raise the green-tabbed release lever on the PCIe riser to the open (up) position, and then gently press the riser into the motherboard connector until it is seated

7. Ensure that the rear bracket on the internal HBA card in PCIe slot 4 is connected to the slot in the server chassis side wall. If the bracket is not connected, remove the riser and reposition it so that the rear bracket connects to the side wall, and then gently press the riser into the motherboard connector

8. Slide the plastic PCIe card retainer, which is mounted on the side of the chassis, toward the back of the server to secure the card(s) installed in the riser

9. Press the green-tabbed release lever on the PCIe riser to the closed (down) position

10. To secure the rear bracket on the PCIe card to the server, close the green-tabbed latch on the rear of the server chassis

11. Reconnect any external cables to the card

Return the server to operation:

1. Install the server top cover.

2. Return the server to the normal rack position.

3. Reconnect the power cord to the server power supply and the data cables.

4. Power on the server.

5. If the PCIe riser fault message in Oracle ILOM is not cleared under Open Problems, you must manually clear the fault in Oracle ILOM. For instructions on how to do this refer to Doc ID 1381773.1 How to clear FMA logs on the ILOM or Solaris on x86 platforms

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE CUSTOMER NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

Boot up system and verify full functionality

REFERENCE INFORMATION:

Oracle Server X6-2 Service Documentation

http://docs.oracle.com/cd/E62159_01/html/E62171/index.html

Attachments

This solution has no attachment