Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-2357848.1
Update Date:2018-05-10
Keywords:

Solution Type  Technical Instruction Sure

Solution  2357848.1 :   How to Replace an Exadata X7-2 Storage Cell Server M.2 SSD Disk and/or Riser Card  


Related Items
  • Exadata X7-2 Hardware
  •  
  • Oracle SuperCluster M8 Hardware
  •  
  • Zero Data Loss Recovery Appliance X7 Hardware
  •  
  • Exadata X7-8 Hardware
  •  
Related Categories
  • PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: x64-CAP VCAP
  •  




Oracle Confidential PARTNER - Available to partners (SUN).
Reason: Exadata internal only for Oracle support engineers use and approved HW partners

Applies to:

Exadata X7-2 Hardware - Version All Versions and later
Exadata X7-8 Hardware - Version All Versions and later
Oracle SuperCluster M8 Hardware - Version All Versions and later
Zero Data Loss Recovery Appliance X7 Hardware - Version All Versions and later
Information in this document applies to any platform.

Goal

How to Replace an Exadata X7-2 Storage Cell Server M.2 SSD Disk and/or Riser Card.

Solution

DISPATCH INSTRUCTIONS:

WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED?:
Exadata X7-2 Training

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 2



FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW: An Exadata X7-2 Storage Cell Server M.2 SSD Disk or Riser needs replacement

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:

IMPORTANT NOTE TO TSC ENGINEER:  CUT & PASTE the “CUSTOMER ACTIVITY” sections of the Pre-Replacement and Post-Replacement steps into a SR Note and ensure the customer is aware to do these steps prior to the scheduled field engineer activity, and during and after the replacement activity.

CUSTOMER ACTIVITY:

The M.2 SSD disk and riser is hot-pluggable and can be replaced when the power is on. 

The slot location of the failed M.2 SSD disk or riser can be verified with the following command:

CellCLI> LIST PHYSICALDISK WHERE diskType=M2Disk AND status!=normal DETAIL
name: M2_SYS_0
deviceName: /dev/sda
diskType: M2Disk
makeModel: "INTEL SSDSCKJB150G7"
physicalFirmware: N2010112
physicalInsertTime: 2017-07-14T08:42:24-07:00
physicalSerial: PHDW7082000M150A
physicalSize: 139.73558807373047G
slotNumber: "M.2 Slot: 0"
status: failed - dropped for replacement

These steps are also provided in the documentation:

   https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN-GUID-5903DF08-A052-4F82-9A87-23A3D6F02DA2


WHAT ACTION DOES THE ENGINEER/ADMINISTRATOR NEED TO TAKE?:

Prepare the Server for Service

M.2 SSD Disks and riser are hot-pluggable and do not require you to power off the server.

1. Locate the cell that has the white LED lit that requires maintenance.
2. Extend the server to the maintenance position

3. Attach an anti-static wrist strap to your wrist and to a metal area on the chassis or the rack.
4. Remove the server top cover. Use a Torx T10 screwdriver to unlock the release button latch.

Caution - These procedures require that you handle components that are sensitive to electrostatic discharge. This sensitivity can cause the component to fail. To avoid damage, ensure that you follow safe anti-static practices.

Identifying and Removing a Faulty M.2 SSD Disk or Riser

1. Identify and note the location of the faulty M.2 SSD disk by pressing the Fault Remind button on the motherboard, and reviewing the cell alert message details.  The faulty M.2 SSD disk is identified with a corresponding amber LED on the M.2 SSD riser board.

  • If the M.2 SSD fault LED is off, then the M.2 SSD is operating properly.
  • If the M.2 SSD fault LED is on (amber), then the M.2 SSD is faulty and should be replaced.

2. Remove the M.2 SSD riser board as follows:
   a. Rotate the two M2. SSD riser board socket ejectors outward as far as they will go.

Note - The green Power LED indicator located on the riser board is extinguished when you open the socket ejectors.

   b. Carefully lift the flash riser board straight up to remove it from the sockets, and place the riser board on an anti-static mat.

3. Using your fingers, push the plastic retainer clip through the riser board to release the M.2 SSD Disk from the M.2 SSD riser board.

4. Remove the plastic retainer clip from the M.2 SSD Disk.  

5. Remove the M.2 SSD Disk from the M.2 SSD riser board as follows:
      a. Lift up on the end of the M.2 SSD Disk approximately one-half inch to one inch (1cm to 2.5cm), in the location where the plastic retainer clip was removed.
      b. Gently slide the M.2 SSD disk rearward and out of the connector to disengage the M.2 SSD disk contacts from the M.2 SSD riser board socket.
      c. Place the M.2 flash SSD on an anti-static mat.

Installing a M.2 SSD Disk into the M.2 SSD Riser

Note - The M.2 SSD Riser has two M.2 sockets. The M.2 SSD Disk replacement should only be installed in the socket labeled SSD0.

1. Unpack the replacement M.2 SSD Disk or Riser and place it on an anti-static mat.

2. Align and insert the plastic retainer clip into the slot on the M.2 SSD Disk.

3. Hold the M.2 SSD Disk so that the end containing the plastic retainer clip is approximately one-half to one inch (1cm to 2.5cm) above the riser board and the other end is adjacent to the riser SSD socket.

4. Gently slide the M.2 SSD Disk forward and into the connector to engage the contacts in the M.2 SSD riser board socket.    

5. Using your fingers, push down on the end of the card containing the plastic retainer clip until the M.2 SSD Disk snaps into place on the riser board.

You will hear an audible click when the M.2 SSD Disk is secured to the M.2 SSD riser board.

 

Installing the M.2 SSD Riser

1. Ensure that the ejector tabs in the motherboard connector slot are in the open position.

2. Align the notch in the replacement riser board with the connector key in the connector socket.
   The notch ensures that the riser board is oriented correctly.

3. Push the riser board into the connector socket until the riser board is securely seated in the socket.

Caution - If the riser board does not easily seat into the connector socket, verify that the notch in the riser board is aligned with the connector key in the connector socket. If the notch is not aligned, damage to the riser board might occur.

4. Rotate the riser board socket ejectors inward until the ejector tabs lock the riser board in place.
   The green power LED on the riser board turns on when you close the socket ejectors.

 

Return the Server to Operation

1. Install the server top cover. Use a Torx T10 screwdriver to lock the release button latch.
2. Return the server to the normal rack position.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

FIELD SERVICE ENGINEER and CUSTOMER ACTIVITY:

After the M.2 SSD disk is replaced, Exadata Storage Server Software automatically adds the new device to the system partition and starts the rebuilding process.

1. Verify all expected hardware is visible to the server and the fault is cleared. Assistance from the customer for server login access will be required.

CellCLI> LIST PHYSICALDISK WHERE DISKTYPE=M2Disk DETAIL
name: M2_SYS_0
deviceName: /dev/sdm
diskType: M2Disk
makeModel: "INTEL SSDSCKJB150G7"
physicalFirmware: N2010112
physicalInsertTime: 2017-08-24T18:55:13-07:00
physicalSerial: PHDW708201G0150A
physicalSize: 139.73558807373047G
slotNumber: "M.2 Slot: 0"
status: normal

name: M2_SYS_1
deviceName: /dev/sdn
diskType: M2Disk
makeModel: "INTEL SSDSCKJB150G7"
physicalFirmware: N2010112
physicalInsertTime: 2017-08-24T18:55:13-07:00
physicalSerial: PHDW708200SZ150A
physicalSize: 139.73558807373047G
slotNumber: "M.2 Slot: 1"
status: normal

2. Verify the system disks have active sync status or are being rebuilt:

# mdadm --detail /dev/md[2-3][4-5]
/dev/md24:
Container : /dev/md/imsm0, member 0
Raid Level : raid1
Array Size : 104857600 (100.00 GiB 107.37 GB)
Used Dev Size : 104857600 (100.00 GiB 107.37 GB)
Raid Devices : 2
Total Devices : 2

State : active
Active Devices : 2
Working Devices : 2
Failed Devices : 0
Spare Devices : 0

UUUID : 152f728a:6d294098:5177b2e5:8e0d766c
Number Major Minor RaidDevice State
1 8 16 0 active sync /dev/sdb
0 8 0 1 active sync /dev/sda
/dev/md25:
Container : /dev/md/imsm0, member 1
Raid Level : raid1
Array Size : 41660416 (39.73 GiB 42.66 GB)
Used Dev Size : 41660544 (39.73 GiB 42.66 GB)
Raid Devices : 2
Total Devices : 2

State : clean
Active Devices : 2
Working Devices : 2
Failed Devices : 0
Spare Devices : 0

UUID : 466173ba:507008c7:6d65ed89:3c40cf23
Number Major Minor RaidDevice State
1 8 16 0 active sync /dev/sdb
0 8 0 1 active sync /dev/sda

3. Verify there are no outstanding faults in ILOM:

# ipmitool sunoem cli 'show faulty'
Connected. Use ^D to exit.
-> show faulty
Target | Property | Value
-------------------+-----------------------+-----------------------------------
-> Session closed
Disconnected

4. Verify there are no outstanding alerts in the Cell:  

# cellcli -e list alerthistory


PARTS NOTE:

7341466 [F] M.2 Form Factor Riser Assembly
7341587 150GB Intel SSDSCKJB150G7 M.2 SATA Solid State Drive With Encryption, FSB Certified

 

REFERENCE INFORMATION:

Oracle Exadata Database Machine Maintenance Guide: https://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-storage-servers.htm#DBMMN21128

Oracle Server X7-2L Documentation https://docs.oracle.com/cd/E72463_01/index.html

 


Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback