Exadata X7-2 Hardware
 
Exadata X7-8 Hardware
 
Oracle SuperCluster M8 Hardware
 
Zero Data Loss Recovery Appliance X7 Hardware
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
 

In this Document

Goal

Solution

References

Oracle Confidential PARTNER - Available to partners (SUN).
Reason: Exadata internal only for Oracle support engineers use and approved HW partners

Applies to:

Goal

How to Replace an Exadata X7-2 Storage Cell Server Internal RAID HBA SuperCap and/or Cable

Solution

DISPATCH INSTRUCTIONS

WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED?:

Exadata X7-2 Training.

TIME ESTIMATE: 30 Minutes

TASK COMPLEXITY: 2

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW: An Exadata X7-2 Storage Cell Server Disk Controller Super Capacitor and/or Super Capacitor Cable needs replacement.

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:

IMPORTANT NOTE TO TSC ENGINEER: CUT & PASTE the “CUSTOMER ACTIVITY” sections of the Pre-Replacement and Post-Replacement steps into a SR Note and ensure the customer is aware to do these steps prior to the scheduled field engineer activity, and during and after the replacement activity.

CUSTOMER ACTIVITY:

Offlining the disk cache and shutdown of the storage cell is required prior to the part replacement.

1. Complete Steps 1 to 5 of MOS Note ID 1188080.1 “Steps to shut down or reboot an Exadata storage cell without affecting ASM”

Where noted, the SQL, CellCLI and commands under ‘root’ should be run by the Customers DBA, unless the Customer provides login access to the Field Engineer.

These steps are also provided in the documentation:
https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

2. Revert all the RAID disk volumes to WriteThrough mode to ensure all data in the RAID cache memory is flushed to disk and not lost when replacement of the SuperCap occurs. As 'root' user, set all logical volumes cache policy to WriteThrough cache mode:

3. Verify the current cache policy for all logical volumes is now WriteThrough:

In the volume table, the "Cache" column should report as "NRWTD" where WT indicates WriteThrough.

4. Once all disks are offline and inactive, the customer may shutdown the Cell using the following command:

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE?:

Prepare the Server for Service

The customer should have already prepared the server and powered it off.  If not, provide them the instructions in the previous section.

1. Extend the server to the maintenance position
2. Disconnect the power cords from the power supplies.
3. Attach an anti-static wrist strap to your wrist and to a metal area on the chassis or the rack.
4. Remove the server top cover. Use a Torx T10 screwdriver to unlock the release button latch.

Removing the Internal RAID HBA Super Capacitor

1. Grasp both ends of the cable connector, press in on the release latch, and then unplug the connector.

2. The HBA super capacitor is secured to the HBA super capacitor tray by a recloseable fastener, which allows it to be easily removed and replaced. To separate the HBA super capacitor from the tray, place your finger under the rear of the super capacitor and lift up. 

3. Carefully pull the the cable through the tray wire guide, making sure it does not snag on the guide.

4. Place the super capacitor on an anti-static mat.

Removing the Internal RAID HBA Super Capacitor Cable

1. The RAID HBA is located in PCIe Slot 11, on the far left side of the chassis when looking from the front. Rotate the Slot 11 PCIe card locking mechanism open.

2. Lift and remove the RAID HBA out of the motherboard slot.

3. Disconnect the Super Capacitor cable from the RAID HBA card.

4. Lift and remove the Super Capacitor cable from the chassis

Installing the Internal RAID HBA Super Capacitor Cable

1. Rotate the Slot 11 PCIe card locking mechanism open, if not already

2. Lift and remove the RAID HBA out of the motherboard PCIe Slot 11.

3. Connect the Super Capacitor cable to the RAID HBA card.

4. Insert the RAID HBA card into PCIe Slot 11

5. Rotate the PCIe locking mechanism to secure the PCIe HBA card in place. You will hear an audible click when the PCIe card is secured into the slot.

Installing the Internal RAID HBA Super Capacitor

1. Unpack the replacement super capacitor, and place it on an anti-static mat.

2. Apply a recloseable fastener to the underside of the super capacitor.

3. Align the recloseable fastener on the super capacitor with the recloseable fastener on the HBA super capacitor tray and press down.

4. Route the super capacitor cable through the tray wire guide on the HBA super capacitor tray and then connect the super capacitor cable.

Return the Server to Operation

1. Install the server top cover. Use a Torx T10 screwdriver to lock the release button latch.
2. Reconnect the power cords to the server power supply and connect any other cables to their original locations.
3. Return the server to the normal rack position.
4. Once the power cords have been re-attached and the ILOM has booted you will see a slow blink on the green LED for the server. Power on the
server by pressing the power button on the front of the unit.
5. Connect to the server console via the ILOM and monitor the boot.
   By default the ILOM serial console displays the primary console output.
   In the event of unexpected boot behavior, it is advisable to connect to both ILOM serial and ILOM graphics consoles at the same time and monitor.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE?:

FIELD SERVICE ENGINEER and CUSTOMER ACTIVITY:

1. Verify all expected hardware is visible to the server and the fault is cleared. Assistance from the customer for server login access will be required.

2. Verify all the expected disk devices are present. For a 1/8th rack Storage Cell there will be 6 disks, for all others there will be 12 disks:

3. Verify the status of the Super Capacitor is visible and 'Optimal':

4. Set all logical drives cache policy to WriteBack cache mode:

5. Verify the current cache policy for all logical volumes is now WriteBack:

In the volume table, the "Cache" column should report as "NRWBD" where WB indicates WriteBack.

6. Verify there are no outstanding alerts in the Cell:

7. Re-activate the Storage Cell grid disks. Follow Steps 7 to 10 of Note ID 1188080.1 “Steps to shut down or reboot an Exadata storage cell without affecting ASM”.

These steps are also provided in the documentation:
 https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

PARTS NOTE:

7086345 [F] 13.5V 6.4F Super Capacitor
7341122 [F] Cable and Super Capacitor Assembly
    - 7332901 Super Capacitor Cable

REFERENCE INFORMATION:

Oracle Exadata Database Machine Maintenance Guide: https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128 

Oracle Server X7-2L Documentation https://docs.oracle.com/cd/E72463_01/index.html

Steps to shut down or reboot an Exadata storage cell without affecting ASM (Doc ID 1188080.1)

This solution has no attachment