Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1943059.1
Update Date:2017-05-11
Keywords:

Solution Type  Technical Instruction Sure

Solution  1943059.1 :   How to Replace an Oracle Database Appliance X3-2, X4-2, or X5-2 IOM in the DE2-24P/DE-24C Storage  


Related Items
  • Oracle Database Appliance X4-2
  •  
  • Oracle Database Appliance X3-2
  •  
  • Oracle Database Appliance X5-2
  •  
Related Categories
  • PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
  •  




In this Document
Goal
Solution


Applies to:

Oracle Database Appliance X3-2 - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance X4-2 - Version All Versions to All Versions [Release All Releases]
Oracle Database Appliance X5-2 - Version All Versions to All Versions [Release All Releases]
x86_64
The Oracle Database Appliance X3-2/X4-2 can have 1 or two storage DE2-24P jbods attached.
The Oracle Database Appliance X5-2 can have 1 or two storage DE2-24C jbods attached.
The I/O Modules (IOMs), are hot-swappable so you can replace them without removing power to any of the nodes.

Goal

 How to Replace an IOM in the DE2-24P storage in an Oracle Database Appliance X3-2/X4-2 or

How to Replace an IOM in the DE2-24C storage in an Oracle Database Appliance X5-2.

Solution


DISPATCH INSTRUCTIONS

- WHAT SKILLS DOES THE ENGINEER NEED:  Trained ODA engineer

- TIME ESTIMATE:  60 minutes

- TASK COMPLEXITY:  2

FIELD ENGINEER INSTRUCTIONS:

- PROBLEM OVERVIEW:

An I/O Controler Module has been determined as failed and needs to be replaced.

- WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:

System can be online.

- WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

A faulted I/O Module will often times have an amber LED.

It is critical that the correct IOM is replaced.  It is recommended that you record the WWN# of the IOM before and after the swap, to make sure the new IOM has a different WWN# than the IOM that was bad.

For example, you can use the following commands to find the WWN# of the IOMs:

# oakcli show storage
==== BEGIN STORAGE DUMP ========
...

Total number of expanders: 2
        Id         = 1
        Serial Num = 50800200014751e4
        Vendor     = ORACLE
        Model      = DE2-24P
        FwVers     = 0018
        strId      = Primary
        WWN        = 50800200014c303e

        Id         = 0
        Serial Num = 50800200014751e4
        Vendor     = ORACLE
        Model      = DE2-24P
        FwVers     = 0018
        strId      = Secondary
        WWN        = 50800200014c307e

# /usr/bin/fwr_exp_util list
0 Controller [/SYS/MB/RISER1/PCIE2] => Expander[1314FM4005 - Primary, wwn: 50800200014c303e, name: Oracle Database Appliance - E0   LED: OFF]
1 Controller [/SYS/MB/RISER2/PCIE3] => Expander[1314FM4005 - Secondary, wwn: 50800200014c307e, name: Oracle Database Appliance - E0   LED: OFF]

Furthermore, you can turn on the led of the faulted IOM, if it's not already on:

# /usr/bin/fwr_exp_util led 50800200014c307e on
Expander [50800200014c307e] LED : Off changed to => On

 

Important: Do not remove a component if you do not have an immediate replacement. The disk shelf must not be operated without all components in place.

  1. Take ESD Precautions.
  2. Locate the failed I/O Module at the back of the disk shelf.
  3. Label and disconnect the I/O Module interface cables.
  4. Using your thumb and forefinger, squeeze the release button toward the lever hole to release the lever.
  5. Grasp the lever and remove the I/O Module, being careful not to damage the connector pins in back.
  6. With the lever of the new I/O Module in the open position, slide the I/O Module into the disk shelf, being careful of the connector pins.
  7. Push the lever fully closed until you hear or feel a click.
  8. Reconnect the interface cables to their original locations.
  9. Wait approximately 60 seconds for the I/O Module to complete its boot process, at which time the Power LED should be solid green and the Fault/Locate LED should be off.  All four activity LEDs should be solid green for each SAS-2 port that has an interface cable connected to it.
  10. Confirm that the new IOM is seen in system:

# oakcli show storage
....
Total number of expanders: 2
        Id         = 0
        Serial Num = 50800200014751e4
        Vendor     = ORACLE
        Model      = DE2-24P
        FwVers     = 0018
        strId      = Secondary
        WWN        = 508002000172ad7e  <<< in this example, we replaced expander 0, which has a different WWN# than previous output

        Id         = 1
        Serial Num = 50800200014751e4
        Vendor     = ORACLE
        Model      = DE2-24P
        FwVers     = 0018
        strId      = Primary
        WWN        = 50800200014c303e

You may also want to check that the cables have been installed correctly.  From both nodes, you can run the following command:

# oakcli validate -c storagetopology

Make sure there are no failures reported during the output of the validate command.

To check the firmware version of the new IOM:

# oakcli show version -detail
Reading the metadata. It takes a while...
System Version Component Name Installed Version Supported Version
-------------- --------------- ------------------ -----------------
12.1.2.10.0         Controller_INT    4.650.00-7176        4.230.40-3739
                         Controller_EXT    10.00.00.00           Up-to-date
                          Expander [ c1x0 ]      0010             0018          <<<<<<<<<<<<<<<< this expander needs to be updated

 


To upgrade the expander firmware, use the oakcli update -patch command, for example:
# oakcli update -patch 12.1.2.6.0 --infra <<<<<<<<<<<<<< be sure to use the version of your ODA software

For version 12.1.2.7.0 and above, the command syntax has changed to --storage, for example:
# oakcli update -patch 12.1.2.7.0 --storage  <<<<<<<<<<<<<< be sure to use the version of your ODA software

******IMPORTANT******

Updating firmware will cause a reboot.

If you cannot take a reboot at this time, please schedule one in the near future to perform the infra update. "


PARTS NOTE:

P/N 7043628 - 6Gbps SAS-2 I/O Controller Module


REFERENCE INFORMATION:

Oracle ZFS Storage Appliance Customer Service Manual
Replacing an I/O Module, page 163


Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback