Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-2301715.1
Update Date:2017-08-28
Keywords:

Solution Type  Technical Instruction Sure

Solution  2301715.1 :   How to Replace an Oracle Database Appliance X6-2 Large Systemboard  


Related Items
  • Oracle Database Appliance X6-2 HA Hardware
  •  
Related Categories
  • PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
  •  




Oracle Confidential PARTNER - Available to partners (SUN).
Reason: CAP for FE or partner FE

Applies to:

Oracle Database Appliance X6-2 Hardware - Version All Versions and later
x86_64

Goal

How to Replace an Oracle Database Appliance X6-2 Large Systemboard

Solution

CAP PROBLEM OVERVIEW: Motherboard replacement

DISPATCH INSTRUCTIONS

WHAT SKILLS DOES THE ENGINEER NEED:
Oracle Database Appliance X6-2L Training.

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 3-FRU

FIELD ENGINEER INSTRUCTIONS

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY? :

If the system is still up and functioning, customer should perform an orderly and graceful shutdown of applications and OS. Then power off the server and remove the AC power cords from the system.

A data backup is not a prerequisite but is a wise precaution.

 

INSTRUCTIONS:

Remove the Motherboard Assembly

1. Log into the ILOM check the fruid container values and sync them if needed.

To avoid mismatched fruid values causing a failure after a motherboard replacement the fruid data should be confirmed to have matching data in at least the Primary (DBP) and Backup2 (PS0) containers so that the motherboard will have it's container updated automatically after replacement. Go into restricted mode and use the showpsnc command to check this.

-> set SESSION mode=restricted

WARNING: The "Restricted Shell" account is provided solely
to allow Services to perform diagnostic tasks.

[(restricted_shell) odax6-2l-brm06-a-sp:~]# showpsnc
Primary: fruid:///SYS/DBP
Backup 1: fruid:///SYS/MB
Backup 2: fruid:///SYS/PS0

Element | Primary
------------------+-------------------
PPN 7338561
PSN 1642NM700J
Product Name ORACLE SERVER X6-2L

Element | Backup1
------------------+-------------------
PPN 7338561
PSN 1642NM700J
Product Name ORACLE SERVER X6-2L

Element | Backup2 (7) | Backup2 (8)
------------------+-------------------+-------------------
PPN 7338561 7338561
PSN 1642NM700J 1642NM700J
Product Name ORACLE SERVER X6-2L ORACLE SERVER X6-2L


The above example shows a system with all three containers properly in sync. If the output from the system does not show all of the containers with matching values then you should reset the SP and then re-check the values again. An ILOM reset will attempt to auto-populate the matching values if one container is out of sync.
-> reset /SP
Are you sure you want to reset /SP (y/n)? y
Performing reset on /SP

After an ILOM reset if the Primary and Backup2 containers match then proceed with the following steps to replace the motherboard. If these two containers do not match then DO NOT proceed with the replacement yet.
If the containers do not match you will need to use the copypsnc command from service or escalation mode to copy the data from the good container so that the Primary and Backup2 containers match (Backup1 is the MB and we are about to replace this so it is not as important at this step). If you are unfamiliar with this process and require assistance please reference the steps for using copypsnc to fix the serial number detailed in the "How to update product serial number on systems which implement TLI functionality (Doc ID 1280913.1)" and contact the TSC if needed. How to access service mode and escalation mode on ILOM 3.x and later platforms (Doc ID 1019946.1)
After the fruid data in the Primary and Backup2 containers have been confirmed to match proceed with the following steps.

2. Prepare the server for service.

Power off the server and disconnect the power cords from the power supplies.
Extend the server to the maintenance position in the rack.
Attach an anti-static wrist strap and remove the top cover and air baffle.

3. Remove the following components:

Fan modules

NVMe cables

PCIe cards

Power supplies

4. Disconnect the ribbon cables from the left front LED indicator module and right front LED/USB indicator module.

5. Disconnect the auxiliary signal cable from the motherboard to the front storage drive backplane.

6. Disconnect the two power cables from the motherboard to the front storage drive backplane.

7. Disconnect the signal cable from the storage server intrusion switch.

8. Remove the mid-wall from the chassis.

  • Using a hex/flat head screwdriver, remove the screw on each side of the chassis that secures the mid-wall to the chassis.
  • Using a No. 2 Phillips screwdriver, loosen the four green captive screws that secure the chassis mid-wall to the bottom of the chassis.
  • Lift the mid-wall out of the chassis.

9. With the storage server in the extended maintenance position, remove the motherboard from the storage server with all reusable components that populate the motherboard in place.

  • Carefully slide the motherboard forward, and lift it out of the chassis.
  • Place the motherboard assembly on an antistatic mat, and next to the replacement motherboard.

10. Remove the following reusable components from the motherboard and install them onto the replacement motherboard.

  • DDR4 DIMMs
  • USB flash drives

11. Remove the processors from the failed motherboard.
12. Remove the processor socket covers from the replacement motherboard and install the processors.

  • Disengage the processor Independent Loading Mechanism (ILM) assembly hinge lever on the right side of the processor socket (viewing the storage server from the front) by pushing down on the lever and moving it to the side away from the processor, and then rotating the lever upward.
  • Disengage the processor ILM assembly load lever on the left side of the processor socket (viewing the storage server from the front) by pushing down on the lever and moving it to the side away from the processor, and then rotating the lever upward.
  • To lift the processor ILM assembly load plate off of the processor socket, rotate the ILM assembly hinge lever on the right side of the processor toward the closed position (the load plate is lifted up as the hinge lever is lowered) and carefully swing the load plate to the fully open position.
  • Grasp the top and underside of the processor socket cover with one hand (place your thumb against the underside of the cover), place your other thumb against the underside of the cover, and carefully push the cover out of the processor ILM assembly load plate.
  • Install a processor into the socket from which you removed the processor socket cover.
  • Repeat through to remove the second processor socket cover from the replacement motherboard and install the second processor.

13. Install the processor socket covers on the faulty motherboard.

 

Install the Motherboard Assembly

1. Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis.
2. Carefully lift and place the motherboard assembly into the chassis.

3. Install the mid-wall into the chassis.

  • Lift and place the mid-wall into the chassis.
  • Using a No. 2 Phillips screwdriver, tighten the four green captive screws that secure the mid-wall to the bottom of the chassis.
  • Using a hex/flat head screwdriver, insert and tighten the screw on each side of the chassis to secure the mid-wall in the chassis.

4. Reconnect the auxiliary signal cable to the motherboard from the front storage drive backplane.

5. Reconnect the power cables to the motherboard from the front storage drive backplane.
6. Reconnect the storage server intrusion switch cable to the motherboard.
7. Reconnect the ribbon cables from left and right LED/USB indicator modules to the motherboard.
8. Reinstall the following components:

  • Power supplies
  • PCIe cards
  • NVMe cables
  • Fan modules

9. Install the air baffle.

Install the air baffle by placing it into the storage server and lowering it to its installed position.
Return the storage server to operation.

10. Install the storage server top cover.

Return the storage server to the normal rack position.

Reconnect the power cords to the power supplies, and power on the storage server.

Verify that the power supply AC OK LED is lit.

 

11. Set the system serial number/fruid data if needed.

The motherboard is not the primary fruid container in this server so when it is replaced you will normally will not need to fix the serial number information.
login to the ILOM as root and then enter the restricted shell to check the fruid values. Follow the example below to enter restricted shell and use the showpsnc command

-> set SESSION mode=restricted

WARNING: The "Restricted Shell" account is provided solely
to allow Services to perform diagnostic tasks.

[(restricted_shell) odax6-2l-brm06-a-sp:~]# showpsnc
Primary: fruid:///SYS/DBP
Backup 1: fruid:///SYS/MB
Backup 2: fruid:///SYS/PS0

Element | Primary
------------------+-------------------
PPN 7338561
PSN 1642NM700J
Product Name ORACLE SERVER X6-2L

Element | Backup1
------------------+-------------------
PPN 7338561
PSN 1642NM700J
Product Name ORACLE SERVER X6-2L

Element | Backup2 (7) | Backup2 (8)
------------------+-------------------+-------------------
PPN 7338561 7338561
PSN 1642NM700J 1642NM700J
Product Name ORACLE SERVER X6-2L ORACLE SERVER X6-2L
[(restricted_shell) odax6-2l-brm06-a-sp:~]#


When the motherboard is replaced the Primary fruid container will likely match the Backup entries. If it does not you must enter escalation or service mode to fix it (if all three entries match this step is done).

** REFER TO DOC ID 1280913.1 for the procedure on how to update the TLI serial number fields **

 

Last step is to check the firmware of the new systemboard, and make sure it's at or above what is expected:

# odacli describe-component
System Version
---------------
12.1.2.11.0

Component                                   Installed Version     Available Version
---------------------------------------- -------------------- --------------------
OAK                                            12.1.2.11.0          up-to-date
GI                                             12.1.0.2.170418      up-to-date
DB                                             12.1.0.2.170418      up-to-date
ILOM                                           3.2.7.26.a.r112632   3.2.9.23.r116695   
BIOS                                           39050100             39070200
OS                                             6.8                  up-to-date

 

In the example above, the ILOM/BIOS need to be updated with the update-server option:

# odacli update-server -v 12.1.2.11.0
{
"jobId" : "b61da17b-7812-405b-9ea2-77312d4ed2f3",
"status" : "Created",
"message" : "Success of Server Update may trigger reboot of node after 4-5 minutes. Please wait till node restart",
"reports" : [ ],
"createTimestamp" : "August 28, 2017 20:17:57 PM MDT",
"resourceList" : [ ],
"description" : "Server Patching",
"updatedTime" : "August 28, 2017 20:17:57 PM MDT"

Once the ILOM has been updated, the server, and the ILOM will reboot itself.  You can then check again, the firmware version:

# odacli describe-component
System Version
---------------
12.1.2.11.0

Component Installed Version Available Version
---------------------------------------- -------------------- --------------------
OAK 12.1.2.11.0 up-to-date
GI 12.1.0.2.170418 up-to-date
DB 12.1.0.2.170418 up-to-date
ILOM 3.2.9.23.r116695 up-to-date
BIOS 39070200 up-to-date
OS 6.8 up-to-date

 

 

 

REFERENCE INFORMATION:

Oracle Dabase Server X6-2S/M/L Documentation

http://docs.oracle.com/cd/E83239_01/index.htm

 

 


Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback