Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1435946.1
Update Date:2017-10-18
Keywords:
Solution Type  Technical Instruction Sure

Solution  1435946.1 :   How to Replace an ODA (Oracle Database Appliance) FAILED/ PredictiveFail Shared Storage Disk  

Related Items 
    

  • Oracle Database Appliance X5-2
    •  
  • Oracle Database Appliance X6-2 HA Hardware
    •  
  • Oracle Database Appliance X3-2
    •  
  • Oracle Database Appliance
    •  
  • Oracle Database Appliance X4-2
    •  
Related Categories 
    

  • PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
    •  






In this Document


Goal


Solution


References


Applies to:  

Oracle Database Appliance - Version All Versions and later
Oracle Database Appliance X4-2 - Version All Versions and later
Oracle Database Appliance X5-2 - Version All Versions and later
Oracle Database Appliance X3-2 - Version All Versions and later
Oracle Database Appliance X6-2 Hardware - Version All Versions and later
Information in this document applies to any platform.



Goal


How to Remove and Replace a Failed or PredictiveFail Shared Storage Disk Drive on an Oracle Database Appliance range of servers.
 


Solution


DISPATCH INSTRUCTIONS:


Disk drives are CRUs (Customer Replaceable Units) and disk drives should be sent to the site for replacement by the customer.


TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 0

PROBLEM OVERVIEW:
Steps to remove a failed hard drive in ODA.

INSTRUCTIONS:
Identify the disk drive that needs replacement, below is an example from both a FAILED disk and a PredictiveFail disk drive:


# oakcli show disk
NAME PATH TYPE STATE STATE_DETAILS

pd_00 /dev/sdam HDD ONLINE Good
pd_01 /dev/sdaw HDD ONLINE Good
pd_02 /dev/sdaa HDD ONLINE Good
pd_03 /dev/sdak HDD ONLINE Good
pd_04 /dev/sdan HDD ONLINE Good
pd_05 /dev/sdax HDD ONLINE Good
pd_06 /dev/sdab HDD ONLINE Good
pd_07 /dev/sdal HDD ONLINE Good
pd_08 /dev/sdao HDD ONLINE Good
pd_09 /dev/sdau HDD FAILED DiskRemoved
pd_10 /dev/sdac HDD ONLINE Good
pd_11 /dev/sdai HDD ONLINE Good
pd_12 /dev/sdap HDD ONLINE Good
pd_13 /dev/sdav HDD ONLINE Good
pd_14 /dev/sdad HDD ONLINE Good
pd_15 /dev/sdaj HDD ONLINE Good
pd_16 /dev/sdaq HDD ONLINE Good
pd_17 /dev/sdas HDD ONLINE Good
pd_18 /dev/sdae HDD ONLINE Good
pd_19 /dev/sdag HDD ONLINE Good
pd_20 /dev/sdar SSD ONLINE Good
pd_21 /dev/sdat SSD ONLINE Good
pd_22 /dev/sdaf SSD ONLINE Good
pd_23 /dev/sdah SSD ONLINE Good


# oakcli show disk
NAME PATH TYPE STATE STATE_DETAILS

pd_00 /dev/sdam HDD ONLINE Good
pd_01 /dev/sdaw HDD ONLINE Good
pd_02 /dev/sdaa HDD ONLINE Good
pd_03 /dev/sdak HDD ONLINE Good
pd_04 /dev/sdan HDD ONLINE Good
pd_05 /dev/sdax HDD ONLINE Good
pd_06 /dev/sdab HDD ONLINE Good
pd_07 /dev/sdal HDD ONLINE Good
pd_08 /dev/sdao HDD ONLINE Good
pd_09 /dev/sdm HDD PARTIAL PredictiveFail
pd_10 /dev/sdac HDD ONLINE Good
pd_11 /dev/sdai HDD ONLINE Good
pd_12 /dev/sdap HDD ONLINE Good
pd_13 /dev/sdav HDD ONLINE Good
pd_14 /dev/sdad HDD ONLINE Good
pd_15 /dev/sdaj HDD ONLINE Good
pd_16 /dev/sdaq HDD ONLINE Good
pd_17 /dev/sdas HDD ONLINE Good
pd_18 /dev/sdae HDD ONLINE Good
pd_19 /dev/sdag HDD ONLINE Good
pd_20 /dev/sdar SSD ONLINE Good
pd_21 /dev/sdat SSD ONLINE Good
pd_22 /dev/sdaf SSD ONLINE Good
pd_23 /dev/sdah SSD ONLINE Good




The above output shows that the disk in slot 9 needs replacement.

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:
It is expected that the ODA is up and running and the node containing the failed drive is booted and available.


Determine the drive slot location for the replacement drive.
If you removed an existing drive from a slot in the system, you must install the replacement drive in the same slot as the drive that was removed. Drives are physically addressed according to the slot in which they are installed.

Use the oakcli locate command to blink the led on the disk to better identify which disk replace:


 


# oakcli locate disk pd_09 on
Disk: pd_09 and to: ON


------------------------------------------------------------------------------------------------------------------------


 


VERY IMPORTANT:  Please wait 7-10 minutes before inserting replacement disk drive.  This gives the software enough time to remove old entries and prepare for a new disk.

After insertion of new disk, run the fwupdate command to make sure the replacement disk is successfully seen by the OS. 

The fwupdate command should list all of the disks under the DISKS section.



For example:


# fwupdate list disk

==================================================

CONTROLLER

==================================================

ID Manufacturer Model Product Name FW Version BIOS Version XML Support

------------------------------------------------------------------------------------------

c0 Intel 0x3a22 - - - N/A

DISKS

===============

ID Manufacturer Model Chassis Slot Type Media Size (GB) FW Version XML Support

------------------------------------------------------------------------------------------

c0d0 SEAGATE ST95001N - 0 sata HDD 500 SA03 N/A

c0d1 SEAGATE ST95001N - 1 sata HDD 500 SA03 N/A

==================================================

CONTROLLER

==================================================

ID Manufacturer Model Product Name FW Version BIOS Version XML Support

------------------------------------------------------------------------------------------

c1 LSI Logic 0x0072 SGX-SAS6-INT-Z 05.00.29.00 07.05.05.00 N/A

DISKS

===============

ID Manufacturer Model Chassis Slot Type Media Size (GB) FW Version XML Support

------------------------------------------------------------------------------------------

c1d0 SEAGATE ST360057SSUN600G 0 0 sas HDD 600 0A25 N/A

c1d1 SEAGATE ST360057SSUN600G 0 1 sas HDD 600 0A25 N/A

c1d2 SEAGATE ST360057SSUN600G 0 2 sas HDD 600 0A25 N/A

c1d3 SEAGATE ST360057SSUN600G 0 3 sas HDD 600 0A25 N/A

c1d4 SEAGATE ST360057SSUN600G 0 4 sas HDD 600 0A25 N/A

c1d5 SEAGATE ST360057SSUN600G 0 5 sas HDD 600 0A25 N/A

c1d6 SEAGATE ST360057SSUN600G 0 6 sas HDD 600 0A25 N/A

c1d7 SEAGATE ST360057SSUN600G 0 7 sas HDD 600 0A25 N/A

c1d8 SEAGATE ST360057SSUN600G 0 8 sas HDD 600 0A25 N/A

c1d9 SEAGATE ST360057SSUN600G 0 9 sas HDD 600 0A25 N/A << make sure slot 9 is listed

c1d10 SEAGATE ST360057SSUN600G 0 10 sas HDD 600 0A25 N/A

c1d11 SEAGATE ST360057SSUN600G 0 11 sas HDD 600 0A25 N/A

c1d12 SEAGATE ST360057SSUN600G 0 12 sas HDD 600 0A25 N/A

c1d13 SEAGATE ST360057SSUN600G 0 13 sas HDD 600 0A25 N/A

c1d14 SEAGATE ST360057SSUN600G 0 14 sas HDD 600 0A25 N/A

c1d15 SEAGATE ST360057SSUN600G 0 15 sas HDD 600 0A25 N/A

c1d16 SEAGATE ST360057SSUN600G 0 16 sas HDD 600 0A25 N/A

c1d17 SEAGATE ST360057SSUN600G 0 17 sas HDD 600 0A25 N/A

c1d18 SEAGATE ST360057SSUN600G 0 18 sas HDD 600 0A25 N/A

c1d19 SEAGATE ST360057SSUN600G 0 19 sas HDD 600 0A25 N/A

c1d20 STEC ZeusIOPs G3 0 20 sas SSD 73 E125 N/A

c1d21 STEC ZeusIOPs G3 0 21 sas SSD 73 E125 N/A

c1d22 STEC ZeusIOPs G3 0 22 sas SSD 73 E125 N/A

c1d23 STEC ZeusIOPs G3 0 23 sas SSD 73 E125 N/A

==================================================

CONTROLLER

==================================================

ID Manufacturer Model Product Name FW Version BIOS Version XML Support

------------------------------------------------------------------------------------------

c2 LSI Logic 0x0072 SGX-SAS6-INT-Z 05.00.29.00 07.05.05.00 N/A

DISKS

===============

ID Manufacturer Model Chassis Slot Type Media Size (GB) FW Version XML Support

------------------------------------------------------------------------------------------

c2d0 SEAGATE ST360057SSUN600G 0 0 sas HDD 600 0A25 N/A

c2d1 SEAGATE ST360057SSUN600G 0 1 sas HDD 600 0A25 N/A

c2d2 SEAGATE ST360057SSUN600G 0 2 sas HDD 600 0A25 N/A

c2d3 SEAGATE ST360057SSUN600G 0 3 sas HDD 600 0A25 N/A

c2d4 SEAGATE ST360057SSUN600G 0 4 sas HDD 600 0A25 N/A

c2d5 SEAGATE ST360057SSUN600G 0 5 sas HDD 600 0A25 N/A

c2d6 SEAGATE ST360057SSUN600G 0 6 sas HDD 600 0A25 N/A

c2d7 SEAGATE ST360057SSUN600G 0 7 sas HDD 600 0A25 N/A

c2d8 SEAGATE ST360057SSUN600G 0 8 sas HDD 600 0A25 N/A

c2d9 SEAGATE ST360057SSUN600G 0 9 sas HDD 600 0A25 N/A << slot 9 should be listed also

c2d10 SEAGATE ST360057SSUN600G 0 10 sas HDD 600 0A25 N/A

c2d11 SEAGATE ST360057SSUN600G 0 11 sas HDD 600 0A25 N/A

c2d12 SEAGATE ST360057SSUN600G 0 12 sas HDD 600 0A25 N/A

c2d13 SEAGATE ST360057SSUN600G 0 13 sas HDD 600 0A25 N/A

c2d14 SEAGATE ST360057SSUN600G 0 14 sas HDD 600 0A25 N/A

c2d15 SEAGATE ST360057SSUN600G 0 15 sas HDD 600 0A25 N/A

c2d16 SEAGATE ST360057SSUN600G 0 16 sas HDD 600 0A25 N/A

c2d17 SEAGATE ST360057SSUN600G 0 17 sas HDD 600 0A25 N/A

c2d18 SEAGATE ST360057SSUN600G 0 18 sas HDD 600 0A25 N/A

c2d19 SEAGATE ST360057SSUN600G 0 19 sas HDD 600 0A25 N/A

c2d20 STEC ZeusIOPs G3 0 20 sas SSD 73 E125 N/A

c2d21 STEC ZeusIOPs G3 0 21 sas SSD 73 E125 N/A

c2d22 STEC ZeusIOPs G3 0 22 sas SSD 73 E125 N/A

c2d23 STEC ZeusIOPs G3 0 23 sas SSD 73 E125 N/A


 


If the newly replaced disk has older firmware from what the ODA Software is expecting, you will need to update the firmware on this disk.  If the disk has newer firmware from the existing disks, this is fine, and the firmware does not need to be downgraded to match existing disks.

To upgrade the disk firmware, use the oakcli update -patch command, for example:


# oakcli update -patch 12.1.2.6.0 --infra <<<<<<<<<<<<<< be sure to use the version of your ODA software


For version 12.1.2.7.0 and above, the command syntax has changed to --storage:


# oakcli update -patch 12.1.2.7.0 --storage


******IMPORTANT******


Updating firmware will cause a reboot.


If you cannot take a reboot at this time, please schedule one in the near future to perform the infra update.


References
 <BUG:21168534> - AFTER DISK REPLACEMENT DISK IS IN UNKNOWN NEWDISKINSERTED



Attachments

This solution has no attachment


















       

Copyright © 2018 Oracle, Inc.  All rights reserved.

 Feedback