Exadata X7-2 Hardware
 
Exadata X7-8 Hardware
 
Oracle SuperCluster M8 Hardware
 
Zero Data Loss Recovery Appliance X7 Hardware
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
 

In this Document

Goal

Solution

References

Oracle Confidential PARTNER - Available to partners (SUN).
Reason: Exadata internal only for Oracle support engineers use and approved HW partners

Applies to:

Goal

How to Replace an Exadata X7-2 Storage Cell Server Internal RAID HBA SAS Data Cables

Solution

DISPATCH INSTRUCTIONS

WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED?:

Exadata X7-2 Training.

TIME ESTIMATE: 60 Minutes

TASK COMPLEXITY: 2

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW: An Exadata X7-2 Storage Cell Server Internal RAID HBA SAS Data Cables need replacement

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY? :

IMPORTANT NOTE TO TSC ENGINEER: CUT & PASTE the “CUSTOMER ACTIVITY” sections of the Pre-Replacement and Post-Replacement steps into a SR Note and ensure the customer is aware to do these steps prior to the scheduled field engineer activity, and during and after the replacement activity.

CUSTOMER ACTIVITY:

Shutdown of the storage cell is required prior to the part replacement.

Follow Steps 1 to 6 of MOS Note ID 1188080.1 “Steps to shut down or reboot an Exadata storage cell without affecting ASM”

Where noted, the SQL, CellCLI and commands under ‘root’ should be run by the Customers DBA, unless the Customer provides login access to the Field Engineer.

These steps are also provided in the documentation:
https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE?:

Prepare the Server for Service

The customer should have already prepared the server and powered it off.  If not, provide them the instructions in the previous section.

1. Extend the server to the maintenance position
2. Disconnect the power cords from the power supplies.
3. Attach an anti-static wrist strap to your wrist and to a metal area on the chassis or the rack.
4. Remove the server top cover. Use a Torx T10 screwdriver to unlock the release button latch.

Removing the Internal RAID HBA SAS Data Cables

1. Open the latch on the SuperCap tray and swing it up from the air baffle.

2. Lift up and remove the air baffle.

3. Remove the Fan Modules and Fan Tray:

1. For each of the fan modules using your forefinger and thumb, lift the fan module straight up and out of the chassis and set them aside on an antistatic mat.
2. With all fan modules removed, using a Torx T25 screwdriver, loosen the three spring-mounted screws that secure the fan tray to the server chassis.
3. Lift the fan tray from the server and set aside.

4. Disconnect the SAS data cables from the disk backplane by pressing the latch on the cable connector and then pulling out the connector. There will be 3 SAS cable ends. Note the cable connection locations so that the 3 cables may be reconnected to their original locations.

5. Disconnect the SAS data cables from the Internal RAID HBA. The RAID HBA is located in PCIe Slot 11, on the far left side of the chassis when looking from the front. Be careful not to disconnect the SuperCap during this process.

1. Rotate the Slot 11 PCIe card locking mechanism open.
2. Lift and remove the RAID HBA out of the motherboard slot.
3. On the SAS data cables, press each latch, and then pull out to disengage the cable from each card connector.
   
4. Temporarily place the RAID HBA back into the PCIe Slot 11.

6. Remove the SAS data cable bundle from the server. Be careful not to snag the cables on the server components.

Install the Internal RAID HBA SAS Data Cables

1. Unpack the replacement SAS data cable bundle.

2. Install the SAS data cable bundle between the disk backplane and the rear PCIe slots. Route the SAS data cable bundle through the cable trough along the left side of the chassis.

3. Connect the 3 SAS data cables to the Internal RAID HBA in PCIe Slot 11. Lift and remove the RAID HBA out of the motherboard slot, and plug each cable into its SAS connector until you hear an audible click.

Ensure the cables are installed in the correct HBA connector slots as they directly connect to the disk slots being connected through them:
 - Cable 1 goes to disk slots 0-3
 - Cable 2 goes to disk slots 4-7
 - Cable 3 goes to disk slots 8-11
 - Disk slots 12-15 connector should be empty.

4. Insert the RAID HBA card into PCIe Slot 11

5. Rotate the PCIe locking mechanism to secure the PCIe HBA card in place. You will hear an audible click when the PCIe card is secured into the slot.

6. Connect the 3 SAS data cables to the disk backplane. There will be 3 SAS data cable ends. Make sure the cables are reconnected to their original locations:
 - Cable 1 is the lowest connector corresponding to disk slots 0-3
 - Cable 2 is the middle connector corresponding to disk slots 4-7
 - Cable 3 is the upper connector corresponding to disk slots 8-11

7. Replace the Fan Modules and Fan Tray:

1. Lower the fan tray into the server.
2. Using a Torx T25 screwdriver, tighten the three spring-mounted screws that secure the fan tray to the server chassis.
3. Install each of the fan modules into the server. The fan modules are keyed to ensure that they are installed in the correct orientation.
4. Press down on each fan module to fully seat the fan module.

8. Lower the air baffle back into place over the DIMMs and CPU's.

9. Lower and clip the SuperCAP tray back into the air baffle.

Return the Server to Operation

1. Install the server top cover. Use a Torx T10 screwdriver to lock the release button latch.
2. Reconnect the power cords to the server power supply and connect any other cables to their original locations.
3. Return the server to the normal rack position.
4. Once the power cords have been re-attached and the ILOM has booted you will see a slow blink on the green LED for the server. Power on the server by pressing the power button on the front of the unit.
5. Connect to the server console via the ILOM and monitor the boot.
   By default the ILOM serial console displays the primary console output.
   In the event of unexpected boot behavior, it is advisable to connect to both ILOM serial and ILOM graphics consoles at the same time and monitor.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE?:

FIELD SERVICE ENGINEER and CUSTOMER ACTIVITY:

1. Verify all expected hardware is visible to the server and the fault is cleared. Assistance from the customer for server login access will be required.

2. Verify all the expected disk devices are present. For a 1/8th rack Storage Cell there will be 6 disks, for all others there will be 12 disks:

3. Verify the status of the Super Capacitor is visible and 'Optimal':

4. Verify all expected logical drives are present and state 'Optl' (Optimal). For 1/8th rack Storage Cells there will be 6 disks, for all others there will be 12 disks:

In the volume table, the "Cache" column should report as "NRWBD" where WB indicates WriteBack.

5. Verify there are no outstanding alerts in the Cell:

6. Re-activate the Storage Cell grid disks. Follow Steps 7 to 10 of Note ID 1188080.1 “Steps to shut down or reboot an Exadata storage cell without affecting ASM”.

These steps are also provided in the documentation:
 https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

PARTS NOTE:

7315464 [F] SAS-3 Data Cable Assembly

REFERENCE INFORMATION:

Oracle Server X7-2L Documentation: https://docs.oracle.com/cd/E72463_01/index.html

Steps to shut down or reboot an Exadata storage cell without affecting ASM (Doc ID 1188080.1)

For a documentation reference, in the "Exadata Database Maintenance Guide", use the section titled "General Maintenance Information" section “Powering On and Off Oracle Exadata Rack/Non-emergency Power Procedures” sub-section “Powering Off (or On) Oracle Exadata Rack/Powering Off Storage Servers.
https://docs.oracle.com/cd/E80920_01/DBMMN/exadata-general-maintenance.htm#GUID-7C50CD88-81E1-479C-A2E4-C68B5618FF7E

This solution has no attachment