How to replace or install the remote mount battery kit in a compatible Engineered System [VCAP]

Asset ID:	1-71-1561949.1
Update Date:	2017-02-03
Keywords:

Solution Type Technical Instruction Sure

Solution 1561949.1 : How to replace or install the remote mount battery kit in a compatible Engineered System [VCAP]

Applies to:

Exadata X4-2 Half Rack - Version All Versions and later
Exadata X4-2 Quarter Rack - Version All Versions and later
Exadata X4-2 Eighth Rack - Version All Versions and later
SPARC SuperCluster T4-4 Full Rack - Version All Versions and later
Big Data Appliance X4-2 In-Rack Expansion - Version All Versions and later
Information in this document applies to any platform.

Goal

How to install or replace the remote mount battery kit in a compatible Engineered System.

Solution

DISPATCH INSTRUCTIONS WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED?: Engineered Systems trained

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 3

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW: A compatible Engineered System (ES) requires the remote mount battery kit for the RAID HBA installed or replaced in the server of the Engineered System. The kit (P/N 7060020) is only compatible and supported with Engineered Systems whose server nodes are based on Sun Server X3-2, Sun Server X3-2L, Sun Server X4-2 and Sun Server X4-2L. This replaces the Battery Backup Unit (BBU) that is normally mounted on the RAID HBA with a BBU that can be accessed externally so that future replacement can be done without requiring the server node to be shutdown to access the BBU internally.

Kit contents 1 Kit contents 2

[Click on attachment sections below for full-size images]

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:

1. Turn on the locate indicator light ‘on’ for easier identification of the server being repaired, using one of the following methods:

(a) If the server number has been identified based on the normal ES numbering scheme counting nodes of the same type from the bottom of the rack to the top, then the Locate Button on the front panel may be pressed.

(b) Login to the server’s ILOM via CLI or Web:

-> set /SYS/LOCATE value=Fast_Blink
Set 'value' to 'Fast_Blink

# ipmitool chassis identify force
Chassis identify interval: indefinite
#

2. The server node needs to have the OS shutdown. The customer should perform this. For specific instructions, refer to the ES specific Owner's Guide and associated MOS Notes for that ES.

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE?:

A PDF version of this procedure with images and Videos showing how to complete these procedures are attached to this MOS Note for download and offline viewing.

NOTE: The Remote mount battery kit FRU comes with disk slot boards and cables for installation in either 1U or 2U nodes. These are pre-assembled for convenience. Use the appropriate board/cable for the system the kit is being used in, and discard the remaining board/cable as a consumable. For 1U use the longer cable and bracket (p/n 7056955 & 7056972). For 2U use the shorter cable and bracket (p/n 7060020 & 7056973). The carrier mounted BBU (p/n 7057184) is pre-installed in one of the brackets for shipping, carefully unlatch and remove it prior to installing the bracket into the server.

Installation of the Remote Mount Battery Kit FRU in ES Server Nodes based on Sun Server X3-2/X4-2 (1U):

These steps are relevant to ES server nodes based on X3-2/X4-2 servers. The remote mount BBU should be installed in the upper right-most front disk slot, normally designated HDD 7. For 1U use the longer cable and bracket (p/n 7056955 & 7056972).

1. Assemble the cable routing bracket and 3 standoffs onto the HBA Interface card (P/N 7055240). The standoffs should be placed on the same side as the interface connectors, and the bracket screwed on from the other side of the board with the 3 screws. The cable bracket legs should be oriented away from the board in the same direction as the standoffs. Refer to photo and video below.

Note: The video shows the cable routing bracket on the same side of the board as the 3 standoffs – either way will work, there is sufficient clearance for the bracket to be on the other side, and it may provide better flexibility for routing and holding the cable. Factory assembled parts are as per the photos.

Photo: 1u and 2u Install step 1 photo A

2. The BBU on the remote-mount tray is pre-installed in one of the disk slot interface brackets for shipping. Carefully unlatch and remove it, setting both BBU remote-mount tray and disk slot bracket aside for later.

3. Slide out the server for maintenance. Do not remove any cables prior to sliding the server forward, or the loose cable ends will jam in the cable management arms. Take care to ensure the cables and Cable Management Arm is moving properly. Refer to MOS Note 1444683.1 for CMA handling training.

4. Remove the AC power cords prior to removing the server’s top cover.

5. Remove the server’s top cover, and open the fan bay door fully.

6. Remove the disk filler panel from HDD 7 slot.

7. Install the disk slot interface bracket and board (with the cable attached) (p/n 7056955 & 7056972) into the disk slot by feeding the cable through and slowly sliding the bracket until it latches on the rear of the disk slot. It should not be able to slide forward once latched, without unlatching the rear tabs. Refer to photo and video below.

1u Install step 7 photo A 1u Install step 7 photo B

8. Remove Fan Modules FM1 and FM2 from the centre of the chassis.

9. Bend the cable connector end at an angle, and feed it through the chassis mid-wall slot alongside the disk backplane SAS cables. Refer to video below.

10. Attach the cable to the HBA Interface board (P/N 7055240) and route it through the cable bracket. The cable connector can only fully seat in one orientation. If it does not appear to seat, carefully remove it, turn it upside down and try again. Refer to video below.
Note: DO NOT attach the cable to the connector on the back side of the HBA. That connector is for LSI's remote battery, not the Oracle remote battery.

11. Remove the HBA PCI card. Refer to video below. On X3-2/X4-2 this is located in slot 4, on the same riser as the IB card:

(a) Remove the PCI Riser containing the PCI card to be serviced by unlatching the 3 latch locations marked and carefully lifting the riser up out of the unit. Leave the IB card cables and IB card attached to the riser. Removing the IB cables first may cause issues with cable bend radii when attempting to re-install them.

(b) Disconnect the SAS cables from PCI card making a note of which port each cable goes into so they can go back into the same port.

12. Remove the old BBU from the HBA (Refer to video below):

(a) Use a No. 1 Phillips screwdriver to remove the 3 retaining screws that secure the battery to the HBA from the underside of the card. Do NOT attempt to remove any screws from the top side of the HBA and battery pack – those screws hold the standoffs that provide the bottom screw holes and should remain with the battery pack.

(b) Detach the battery pack including circuit board from the HBA by gently lifting it from its circuit board connector on the top side of the HBA.

13. Attach the HBA Interface board (P/N 7055240) to the HBA connector where the old battery pack was, routing the cable back along the HBA to the rear towards the SAS connectors. Use a No. 1 Phillips screwdriver to install the 3 retaining screws that secure the interface board to the HBA from the underside of the card. Refer to photos and video below.

1u Install step 13 photo A 1u Install step 13 photo B

14. Reinstall the HBA PCI card into the PCI riser and server, reversing the removal step 10 above. Take care to get the SAS cables re-connected to the same ports they were removed from. If reversed, this may affect disk slot mappings. Ensure the SAS cables and the added battery interface cable are routed through the channel cutout in the server air guide. Refer to photos and video below.

1u Install step 14 photo A 1u Install step 14 photo B 1u Install step 14 photo C

15. Insert and carefully slide in the new BBU mounted on the carrier into HDD7 disk slot, and latch it closed. Reer to photo and video below.

1u Install step 15 and 19

16. Re-install Fan Modules FM1 and FM2 in the centre of the chassis. Close the fan door.

17. Replace the server’s top cover and re-attach the AC power cords. ILOM will take up to 2 minutes to boot.

18. Slide the server back into the rack.

19. Attach the smaller orange BBU label over the top of the HDD7 disk slot label to indicate this slot is now for use with a BBU only. Refer to video below.

Installation of the Remote Mount Battery Kit FRU in ES Server Nodes based on Sun Server X3-2L/X4-2L (2U):

These steps are relevant to ES server nodes based on X3-2L and X4-2L servers. The remote mount BBU should be installed in the right-most rear disk slot, normally designated “REAR HDD 1”. For 2U use the shorter cable and bracket (p/n 7060020 & 7056973).

2.The BBU on the remote-mount tray is pre-installed in one of the disk slot interface brackets for shipping. Carefully unlatch and remove it, setting both BBU remote-mount tray and disk slot bracket aside for later.

4. Remove the AC power cords prior to removing the server’s top cover.

5. Remove the disk filler panel from REAR HDD 1 slot. Disengage and partially remove the disk filler panel from REAR HDD 0 slot. Refer to video below.

6. Remove the rear disk backplane, loosening the 2 screws that hold it in place, and lifting it up and off the mounting tab. The cables may remain attached to it. Refer to video below.

7. Install the disk slot interface bracket and board (with the cable attached) (p/n 7060020 & 7056973) into the disk slot by feeding the cable through and slowly sliding the bracket until it latches on the rear of the disk slot. Refer to video below.

8. Attach the cable to the HBA Interface board (P/N 7055240) and route it through the cable cutout where the other rear disk cables route. The cable connector can only fully seat in one orientation. If it does not appear to seat, carefully remove it, turn it upside down and try again. Refer to video below.
Note: DO NOT attach the cable to the connector on the back side of the HBA. That connector is for LSI's remote battery, not the Oracle remote battery.

9. Slide open the retaining latch and remove the HBA PCI card. On X3-2L/X4-2L this is located in slot 6. Refer to video below.

10. Disconnect the SAS cables from PCI card making a note of which port each cable goes into so they can go back into the same port.

11. Remove the old BBU from the HBA (Refer to video below):

(b) Detach the battery pack including circuit board from the HBA by gently lifting it from its circuit board connector on the top side of the HBA.

12. Attach the HBA Interface board (P/N 7055240) to the HBA connector where the old battery pack was, routing the cable back along the HBA to the rear towards the SAS connectors. Use a No. 1 Philips screwdriver to install the 3 retaining screws that secure the interface board to the HBA from the underside of the card. Refer to photo and video below.

2u Install step 12

13. Re-connect the SAS cables to the HBA card, taking care to get the SAS cables in the same ports they were removed from.

14. Reinstall the HBA PCI card into PCI slot 6 of the server and latch it. Refer to video below.

15. Reinstall the rear disk backplane, routing the cables through the normal chassis cutout. The battery interface cable will rest in front of the backplane, routing between the chassis cutout and the backplane. Refer to photo and video below.

2u Install step 15

16. Re-engage the disk filler panel in REAR HDD Slot 0.

17. Insert and carefully slide in the new BBU carrier in REAR HDD Slot 1, and latch it closed. Refer to video below.

18. Replace the server’s top cover and re-attach the AC power cords. ILOM will take up to 2 minutes to boot.

19. Slide the server back into the rack.

20. Attach the larger white BBU label over the top of the “REAR HDD 1” disk slot label to the right of the PS1 bay to indicate this slot is now for use with a BBU only. Refer to photo below.

2u Install step 20

Replacement of the Remote Mount Battery Kit FRU:

If a server node already has the remote mount battery kit installed in the factory or during a previous part replacement, then the kit is used as a FRU in the event of a part failure with the kit board or cable components. In this case, all the components in the remote mount battery kit FRU would need replaced. Reverse the installation instructions below to replace all the kit components at the same time, including the remote mounted battery.

For removal of the disk slot interface board and bracket, gently press the rear latching tabs to disengage it from the slot, while pulling the inside bracket forward. It will latch in multiple places on both sides, before coming fully free to slide out. Slide the cable through with it. Refer to the video attached for specific detail.

OBTAIN CUSTOMER ACCEPTANCE WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO
RETURN THE SYSTEM TO AN OPERATIONAL STATE:

The following steps should be done in co-operation with the customer’s administrator to complete the procedure and verification prior to the field engineer leaving the customer site.

The following steps should be completed to return the system to service.

1. Power on the server by pressing the power button.

2. Turn off the server’s locate LED by pressing the white Locate button.

3. Connect to the server’s console. To connect to the server’s console through ILOM:

(a) From the ILOM Web browser (preferred):
Access the “Remote Control → Redirection” tab and then click on the “Launch Remote Console” button.

(b) From the ILOM CLI: → start /HOST/console

4. From the server’s console and monitor the system booting. Watch in particular, the LSI controller BIOS while it is loading. If it gives a warning message regarding drives with preserved cache, then choose “D” to discard the cache and continue. If it gives a warning message regarding drives are in write-through mode due to a low battery, then chose to continue.

5. Once full boot is completed you should be able to login as ‘root’ user and verify the new battery is seen and is charging.

Linux:

# /opt/MegaRAID/MegaCli/MegaCli64 -adpbbucmd -a0

Solaris:

# /opt/MegaRAID/MegaCli -adpbbucmd -a0

6. Once the server is booted and the battery verified, the customer administrator may need to do additional steps to bring the application services online.

PARTS NOTE:

7057184 Remote Mount Battery Assembly FRU (Battery 7050794 mounted on a Sled Assembly for disk slot installation).

7060020 Remote Mount Battery Kit FRU (for 1U & 2U; includes 7057184 remote mount battery assembly as well)

Systems with the Remote Mount Battery Kit should use FRU 7057184, and should NOT use FRU 7050794. 7057184 includes 7050794. 7050794 is just the battery intended for mounting directly on the HBA, in systems that do not have the remote mount battery kit.

REFERENCE INFORMATION:

PDF version of this document with photos in-line.

ILOM 3.1 documentation library - https://docs.oracle.com/cd/E24707_01/index.html

LSI MegaRAID User’s Guide - http://www.avagotech.com/support/oem/oracle/6gb/sg_x_sas6-r-int-z

Exadata documentation library for customers - https://docs.oracle.com/cd/E50790_01/doc/index.htm in the "Oracle® Exadata Database Machine Maintenance Guide"

Note 1329989.1 Reference guide for LSI disk controller batteries used in Exadata

Note 1528014.1 How to Replace a HBA Battery Backup Unit (BBU) on Exadata Database Machine (X3-2, X3-8, X4-2) (FRU CAP)

VIDEO References:

These require a MP4 video player. Some video links may not load directly in the browser, then save to disk when prompted or using the attachment links below, and then play.

Note - the videos do not have any audio to reduce file size and remove datacenter noise.

1u and 2u Install - Part 1 - Step 1 [0:51]

1u Install:

- Part 2 - Step 7 [0:56]
- Part 3 - Steps 9, 11 [1:02]
- Part 4 - Steps 10, 12 [0:52]
- Part 5 - Steps 13, 14 [1:01]
- Part 6 - Steps 14, 16 [0:55]
- Part 7 - Steps 15, 19 [0:52]

2u Install:

- Part 2 - Steps 5, 6, 7 [1:02]
- Part 3 - Steps 7, 15, 8 [0:54]
- Part 4 - Steps 9, 10, 11 [0:48]
- Part 5 - Steps 12, 13 and 14 [1:02]
- Part 7 - Steps 17 [0:26]

Attachments

This solution has no attachment