Zero Data Loss Recovery Appliance X6 Hardware
 
Exadata X5-2 Hardware
 
Exadata X5-2 Full Rack
 
Exadata X5-2 Eighth Rack
 
Exadata X6-2 Hardware
 
Exadata X5-2 Quarter Rack
 
Exadata X5-2 Half Rack
 
Zero Data Loss Recovery Appliance X5 Hardware
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
 

In this Document

Goal

Solution

References

Oracle Confidential PARTNER - Available to partners (SUN).
Reason: FRU replacement on Engineered system

Applies to:

Goal

 How to Replace Disk backplane on an Exadata X5-2/X6-2 compute node

Solution

CAP PROBLEM OVERVIEW: Storage Disk Backplane Replacement

DISPATCH INSTRUCTIONS

WHAT SKILLS DOES THE ENGINEER NEED:
Oracle Server X5-2 Training.

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 1-FRU

FIELD ENGINEER INSTRUCTIONS

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY? :

If the system is still up and functioning, customer should perform an orderly and graceful shutdown of applications and OS.  Then power off the server and remove the AC power cords from the system.

A data backup is not a prerequisite but is a wise precaution.

Refer to Doc: How to shutdown and startup Exadata X5 compute node and storage cells when performing hardware
maintenance (Doc ID 1982342.1)

For Extended information on this section, check MOS Note 1093890.1 Steps To Shutdown/Startup The Exadata & RDBMS
Services and Cell/Compute Nodes On An Exadata Configuration. (https://support.oracle.com/epmos/faces/ui/km
/SearchDocDisplay.jspx?id=1093890.1&type=DOCUMENT )

For a documentation reference, in the Exadata Owner’s Guide (E13874), use the section of chapter 7 titled “Non-Emergency Power
Procedures” section “Powering Off Oracle Exadata Rack” sub-section “Powering off Database Servers” available on the customer's
cell server image in the /opt/oracle/cell/doc.

http://amomv0115.us.oracle.com/archive/cd_ns/E13877_01/doc/doc.112/e13874/maintenance.htm#autoId18

WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

Reference Doc:
Oracle Server X5-2 Remove the Disk Backplane
http://docs.oracle.com/cd/E41059_01/html/E48312/napsm.z40011771417723.html#scrolltoc

1. Log into the ILOM check the fruid container values and sync them if needed.

1. To avoid mismatched fruid values causing a failure after a disk backplane replacement the fruid data should be confirmed to have matching data in at least the Backup1 (MB) and Backup2 (PS0) containers so that the disk backplane will have it's container updated automatically after replacement. Go into restricted mode and use the showpsnc command to check this.  
   -> set SESSION mode=restricted
   
   WARNING: The "Restricted Shell" account is provided solely
   to allow Services to perform diagnostic tasks.
   
   [(restricted_shell) x5-2]# showpsnc
   Primary: fruid:///SYS/DBP
   Backup 1: fruid:///SYS/MB
   Backup 2: fruid:///SYS/PS0
   
   Element           | Primary           | Backup1           | Backup2
   ------------------+-------------------+-------------------+-------------------
   PPN                 33154574+1+1        33154574+1+1        33154574+1+1
   PSN                 1449NM1018          1449NM1018          1449NM1018
   Product Name        ORACLE SERVER X5-2  ORACLE SERVER X5-2  ORACLE SERVER X5-2
   [(restricted_shell) x5-2]# exit
    
2. The above example shows a system with all three containers properly in sync. If the output from the system does not show all of the containers with matching values then you should reset the SP and then re-check the values again. An ILOM reset will attempt to auto-populate the matching values if one container is out of sync.  
   -> reset /SP
   Are you sure you want to reset /SP (y/n)? y
   Performing reset on /SP
    
3. After an ILOM reset if the Backup1 and Backup2 containers match then proceed with the following steps to replace the disk backplane. If these two containers do not match then DO NOT proceed with the replacement yet.
4. If the containers do not match you will need to use the copypsnc command from service or escalation mode to copy the data from the good container so that the Backup1 and Backup2 containers match (Primary is the DBP and we are about to replace this so it is not as important at this step). If you are unfamiliar with this process and require assistance please reference the steps for using copypsnc to fix the serial number detailed in the "How to update product serial number on systems which implement TLI functionality (Doc ID 1280913.1)" and contact the TSC if needed. How to access service mode and escalation mode on ILOM 3.x and later platforms (Doc ID 1019946.1)
5. After the fruid data in the Backup1 and Backup2 containers have been confirmed to match proceed with the following steps.

2. Prepare the server for service.

1. Power off the server and disconnect the power cords from the power supplies.
2. Extend the server to the maintenance position in the rack.
3. Attach an anti-static wrist strap.

3. Remove all of the Fan Modules.

1. Open the Server Fan Door. Slide the fan door latches forward and swing the door up to the open position.
2. Using your thumb and forefinger, grasp each of the fan modules in the finger recesses located in the plastic between the fans.
3. Lift the fan modules straight up and out of the chassis.

4. Remove all of the storage drives from the storage drive cage.

1. On each drive, push the latch release button to open the latch
2. Grasp the latch and pull each of the drives far enough out so that they disengage from the backplane.
3. It is not necessary to completely remove the storage drives from the server; simply pull them out far enough to disengage them from the disk backplane. If you do remove the storage drives from the server, record their locations so that you can reinstall them in the same locations.

5. Remove the top cover from the storage drive cage.

1. Remove six Phillips screws from the top of the drive cage — three on each side.
2. Open the server's fan door by sliding the fan door latches forward and swinging the door up.
3. Slide the storage drive cover forward (toward the front of the server) and lift it up.

6. Disconnect the cables and remove the storage drive backplane.

1. Disconnect the SAS cables and the switch card cables (if present) from the disk backplane.
2. If the server has a DVD drive disconnect the DVD drive signal cable from the DVD drive and the DVD power cable from the disk backplane. Then remove the DVD drive.
3. Disconnect the disk backplane auxiliary signal cable from the disk backplane.
4. Disconnect the disk backplane power cable from the disk backplane.
5. Loosen the captive screw that secures the disk backplane to the chassis. The screw is on the right backside of the backplane if facing the front of the server.
6. Lift the metal spring retainer on the left side of the disk backplane, when facing the front of the server, lift the disk backplane up and tilt the bottom toward the rear of the server to free it from the holding brackets, and lift it out of the server.
7. Place the disk backplane on an antistatic mat.

7. Install the replacement storage drive backplane and connect the cables.

1. Lift the metal spring retainer and position the backplane so that it fits into the two metal brackets that are located on the chassis side walls.
2. Lower the disk backplane into the disk cage so that it engages the three metal hooks in the disk cage. These are spaced across the middle of the backplane.
3. Continue to lower the disk backplane into the disk cage until it is positioned in all six troughs that are located at the bottom of the disk cage.
4. Turn the disk backplane captive screw clockwise until the disk backplane is secure.
5. Reconnect the disk backplane power cable to the disk backplane.
6. If the server has a DVD drive install the DVD drive into the disk drive cage and reconnect the DVD cable signal connector to the DVD drive.
7. Reconnect the DVD cable power connector to the disk backplane.
8. Reconnect the disk backplane auxiliary power and signal cable to the disk backplane.
9. Reconnect the SAS cables and the switch card cables (if present) to the disk backplane.

8. Re-install the storage drives into the storage drive cage.

1. Making sure to install the drives back into the same slots from which they were removed align the drive to the drive slot.
2. Slide the drive into the bay until the drive is fully seated.
3. Close the drive latch to lock the drive in place.

9. Re-install the top cover to the storage drive cage.

1. Place the drive cage cover over the server's drive cage and slide it back to align the screw holes with the proper holes in the top of the chassis frame.
2. Install the six Phillips screws (three on each side) to secure the cover to the server.

10. Re-install the Fans.

1. Install the fan modules into the server.
2. For each module press down on the fan module and apply firm pressure to fully seat the fan module.
3. Close the fan door.

11. Return the Server to operation.

1. Remove any anti-static measures that were used.
2. Return the server to it's normal operating position within the rack.
3. Re-install the AC power cords and any data cables that were removed.
4. Power on server. Verify that the Power/OK indicator led lights steady on.

12. Set the system serial number/fruid data if needed.

1. The disk backplane is the primary fruid container in this server so when it is replaced you will normally need to fix the serial number information.
2. login to the ILOM as root and then enter the restricted shell to check the fruid values. Follow the example below to enter restricted shell and use the showpsnc command   
   -> set SESSION mode=restricted
   
   WARNING: The "Restricted Shell" account is provided solely
   to allow Services to perform diagnostic tasks.
   
   [(restricted_shell) x5-2:~]# showpsnc
   Primary: fruid:///SYS/DBP
   Backup 1: fruid:///SYS/MB
   Backup 2: fruid:///SYS/PS0
   
   Element           | Primary           | Backup1           | Backup2
   ------------------+-------------------+-------------------+-------------------
   PPN                 33154574+1+1        33154574+1+1        33154574+1+1
   PSN                 0000000000          1449NM1018          1449NM1018
   Product Name        ORACLE SERVER X5-2  ORACLE SERVER X5-2  ORACLE SERVER X5-2
   [(restricted_shell) x5-2:~]#
3. When the disk backplane is replaced the Primary fruid container will likely not match the Backup entries. If it does not you must enter escalation or service mode to fix it (if all three entries match this step is done).
4. Contact the TSC to request an escalation password (service mode will work also if just the copypsnc command ends up needing to be used, if the setpsnc command is needed escalation mode is required. setpsnc is not covered in this procedure).
5. Provide your TSC contact the output from the following ILOM commands- "version", "show /SYS product_serial_number", and "show /SP/clock". If the product_serial_number information does not give good output then provide the showpsnc output that was seen in step b above as well.
6. The TSC will provide an escalation password that is made up of 32 short words. Follow the example below to create a new user with the 'Service' role assigned. The Service role is required to access service or escalation modes. In the following example we will create a user named 'escuser' with the service role.
   -> cd /SP/users
   /SP/users
   -> create escuser
   Creating user...
   Enter new password: ********
   Enter new password again: ********
   Created /SP/users/escuser
   -> set escuser role=aucros
   Set 'role' to 'aucros'
   -> show escuser
   /SP/users/escuser
   Targets:
   ssh
   Properties:
   role = aucros
   password = *****

g.Set the check_physical_presence to false and then exit from the ILOM so that you can login as the newly created user. 

h.Login using the escuser login and enter escalation mode using the password that was provided by the TSC.

 i.Use the showpsnc command to confirm the current container values. Confirm that one of the backup containers has a serial number (the value on the PSN line) that matches the system serial number. The system serial number can be checked by comparing to the serial number RFID tag on the front left hand side of the server. After confirming that there is a valid fruid backup use the copypsnc command to write the good data from the backup to the primary container on the DBP. The following example shows copying from backup1 to the primary but you could also copy from backup2 if needed.

j.At this point if all of the fruid containers match and have the correct serial number data this step is done. If more than one of the fruid containers had non-valid entries then the copypsnc command should be used to copy over the valid data to the other container that is not valid. (ie. "copypsnc Backup1 Backup2" to copy backup1 to backup2) After confirming all fruid data is correct reset the ILOM to confirm that the fruid data persists through a reboot and remove the escalation user if needed.

k.If trouble is encountered during any of the steps of accessing escalation mode and fixing the fruid containers please contact the TSC for assistance. 

How to verify the Disk Backplane is working properly.

     1.  Log into ILOM to confirm if disk backplane status is working properly.

Sample

  2.  Check ILOM event log to see if any error related backplane.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE CUSTOMER NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

Boot up system and verify full functionality.

Refer to doc How to shutdown and startup Exadata X5 compute node and storage cells when performing hardware
maintenance (Doc ID 1982342.1)

REFERENCE INFORMATION:

Oracle Server X5-2 Documentation
http://docs.oracle.com/cd/E41059_01/index.html

Oracle Server X5-2 Install the Disk Backplane
http://docs.oracle.com/cd/E41059_01/html/E48312/napsm.z40011771417768.html#scrolltoc

This solution has no attachment