Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1386224.1
Update Date:2017-08-29
Keywords:

Solution Type  Technical Instruction Sure

Solution  1386224.1 :   How To Replace A PCIe Card In A Sun ZFS Unified Storage Appliance [VCAP]  


Related Items
  • Sun ZFS Storage 7320
  •  
  • Exalogic Elastic Cloud X4-2 Eighth Rack
  •  
  • Exalogic Elastic Cloud X3-2 Eighth Rack
  •  
  • Oracle Exalogic Elastic Cloud X2-2 Qtr Rack
  •  
  • Oracle ZFS Storage ZS5-2
  •  
  • Exalogic Elastic Cloud X4-2 Full Rack
  •  
  • Oracle ZFS Storage ZS3-2
  •  
  • Oracle ZFS Storage ZS3-4
  •  
  • Exalogic Elastic Cloud X3-2 Half Rack
  •  
  • Sun Storage 7410 Unified Storage System
  •  
  • Exalogic Elastic Cloud X4-2 Hardware
  •  
  • Oracle Exalogic Elastic Cloud X2-2 One-Eighth Rack
  •  
  • Sun ZFS Storage 7420
  •  
  • SPARC SuperCluster T4-4 Half Rack
  •  
  • Oracle ZFS Storage ZS5-4
  •  
  • Oracle Exalogic Elastic Cloud X2-2 Full Rack
  •  
  • Exalogic Elastic Cloud X3-2 Hardware
  •  
  • Exalogic Elastic Cloud X4-2 Quarter Rack
  •  
  • Exalogic Elastic Cloud X4-2 Half Rack
  •  
  • Oracle ZFS Storage ZS4-4
  •  
  • Sun Storage 7310 Unified Storage System
  •  
  • Oracle ZFS Storage ZS3-4
  •  
  • SPARC SuperCluster T4-4
  •  
  • Exalogic Elastic Cloud X3-2 Full Rack
  •  
  • SPARC SuperCluster T4-4 Full Rack
  •  
  • Exalogic Elastic Cloud X3-2 Quarter Rack
  •  
  • Sun ZFS Backup Appliance
  •  
  • Sun Storage 7110 Unified Storage System
  •  
  • Oracle Exalogic Elastic Cloud X2-2 Half Rack
  •  
  • Sun ZFS Storage 7120
  •  
  • Oracle Exalogic Elastic Cloud X2-2 Hardware
  •  
Related Categories
  • PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: DISK-CAP VCAP
  •  
  • Microlearning>Video>ML-VID-VCAP
  •  




In this Document
Goal
Solution
References


Applies to:

Oracle ZFS Storage ZS3-2 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7120 - Version All Versions to All Versions [Release All Releases]
Exalogic Elastic Cloud X3-2 Eighth Rack - Version X3 and later
Oracle Exalogic Elastic Cloud X2-2 Hardware - Version X2 and later
Oracle Exalogic Elastic Cloud X2-2 One-Eighth Rack - Version X2 and later
7000 Appliance OS (Fishworks)

Goal

How to replace a PCIe-card in a Sun ZFS Unified Storage Appliance head.
All models except 7210 and 7720 (7720 was never shipped )are covered here.

Solution

DISPATCH INSTRUCTIONS


WHAT SKILLS DOES THE ENGINEER NEED: ZFS Storage Apliance experience, x64 hardware

TIME ESTIMATE: 60 minutes
TASK COMPLEXITY: 0 

FIELD ENGINEER INSTRUCTIONS
- PROBLEM OVERVIEW:

This part is a CRU for all models of the ZFS Storage Appliance and ZFS Backup Appliance and a FRU for the ZS3-ES and 7320 ZFS Storage Appliances included within Exalogic systems and SuperCluster and any other Engineered system with an included ZFS Storage appliance.


What: Replace a PCIe-card
Where: ---> (to be inserted by Oracle Support)
Why: A PCIe card has been determined faulty due to alerts or diagnosis of the SR-owner.

- WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:
The system needs to be powered off before corrective actions are initiated.

- WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

Caution: This procedure requires that you handle components that are sensitive to static discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components.

NOTE: If SAS-HBA's are to be replaced all HBA's must be of the same type. SAS-1 and SAS-2 HBA's cannot be installed simultaneously in these systems.

NOTE2: For Clustered Systems

It is MANDATORY NOW THAT YOU UNPLUG THE  CLUSTRON CABLES (UART0 and UART1 ) and take notice that these cables  are crossover connected.

THEY WILL NEED TO BE REPLUGGED IN THE SAME WAY AFTER THE HW REPLACEMENT ACTION HAS BEEN COMPLETED.

Preparation:

NOTE: If the PCI card replaced is an Infiniband HCA please refer to KM Doc: Updating IB partitions after replacing an Infiniband HCA in any nodes within IB network - steps to do after replacing HCA (Doc ID 1985159.1)  This document contains some steps to complete prior to removing the old card from the system, as well as post-replacement steps.


1. Disconnect the AC power cords from the rear panel of the storage controller.
2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack.
3. From the front of the storage controller, release the two slide release latches.
4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch.

To remove the top cover:
For 7110, 7310, 7410, 7120, 7320 and ZS3-2
1. Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there.
2. Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm).
3. Lift up and remove the top cover.

For 7420 and ZS3-4
1. Simultaneously lift both cover latches in an upward motion. Lift up and remove the top cover.

For ZS4-4
1. Fully loosen the two captive screws at the rear of the top cover.
2. Slide the top cover rearward 0.5 inches (13mm) and lift straight up and off the chassis.

Locate the PCIe card position in the storage controller,

To Replace the PCIe card:

For 7110, 7310, 7410, 7120, 7320 and ZS3-2:
1 Disconnect any data cables connected to the cards on the PCIe riser you want to replace. Label the cables for proper connection later.
2. Loosen the two captive Phillips screws on the end of the rear panel crossbar and lift the crossbar up and back to remove it.
3. Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser.
4. Lift the riser up to remove it from the storage controller. Place it on an ESD-protected surface.
5. Carefully remove the PCIe card from the riser board connector and clean the slot with filtered, compressed air if necessary.
6. Seat the replacement PCIe card in the slot of the riser and connect the cables.
7. Align the riser, together with any attached PCIe cards, with the intended location on the motherboard, and carefully insert it into its slot.
8. Slide the back of the riser into the motherboard rear panel stiffener.
9. Tighten the screw that secures the riser to the motherboard.
10. Replace the rear panel PCI crossbar by sliding it down over the PCIe risers, ensuring the crossbar is secured with two captive Phillips screws.

For 7420 and ZS3-4:
1. Disengage the PCIe card slot crossbar from its locked position and rotate the crossbar into an upright position.
2. Remove the retaining screw that holds the PCIe card to the chassis.
3. Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary.
4. Install the replacement PCIe card into the PCIe card slot.
5. Install the retaining screw to hold the PCIe card to the chassis.
6. Return the crossbar to its closed and locked position.

For ZS4-4:
1. To disengage the PCIe card retaining bar, push down on the bar and move it away from the controller back wall, then lift to an upright position.
2. Carefully remove the PCIe card from the PCIe card slot. Clean the slot with filtered, compressed air if necessary.
3. Install the replacement PCIe card into the PCIe card slot.
4. Return the retaining bar to it's locked position.

To install the top-cover:

For 7110, 7310, 7410, 7120 ,7320 and ZS3-2
Components may differ slightly between the systems, however service procedures for each are identical.
1. Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm), then slide the top cover forward until it seats.
2. Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on.

For 7420 and ZS3-4:
1. Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
2. Slide the top cover toward the rear of the chassis until it seats.
3. Press down on the cover with both hands until both latches engage.

For ZS4-4:
1. Place the top cover in position on the chassis.
2. Push forward 0.5 inches(13mm)
3. Engage the captive screws and tighten them with a phillips screwdriver


Returning the system to operation:

NOTE: IF THIS IS A CLUSTER, PLUG CLUSTRON CABLES (UART0 and UART1) back as crossover configuration.

MAKE SURE THEY ARE NOT CABLED STRAIGHT THROUGH, i.e. UART0 with UART0, and UART1 with UART1.


head 1       head 2
UART0 <-> UART1
UART1 <-> UART0
DLPI <->    DLPI


1. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
2. Connect the power cords to the power supplies.
3. Connect data cables to the PCIe card, routing them through the cable management arm.
4. Verify that standby power is on, indicated by the Power/OK status indicator flashing on the front panel about two minutes after the power cords are plugged in.
5. Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit.
Once system has booted, go to the Maintenance ; Hardware screen of the BUI, and click the details icon on the controller. Then, click Slots to verify the status of the new component. The status indicator should appear green.

OBTAIN CUSTOMER ACCEPTANCE

- WHAT ACTION DOES THE CUSTOMER NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:


Once system has booted, go to the Maintenance &gt; Hardware screen of the BUI, and click the details link under the controller. Then, click Slots to verify the status of the new component. The status indicator should appear green.
Go to Maintenance ; Active Problems and Mark Repaired ; any prior faults related to device.

PARTS NOTE:
Several different PCIe cards can be used in these systems, there are support-rules on what PCIe-card can go into which slot, refer to the online documentation to make sure the card is installed in a supported slot.

CAUTION!:   If you are replacing a IB card you will have to  check the FW and update it if required. see KM


Oracle ZFS Storage Appliance: Procedure to Upgrade IB HCA Firmware in CLI (Doc ID 2029161.1)

This is at the shell prompt so not a customer action . You will have to log a support call to get TSC to do this at F/W update at this time.

REFERENCE INFORMATION:

References

Oracle Unified Storage Systems Documentation : http://www.oracle.com/technetwork/documentation/oracle-unified-ss-193371.html
CRU Maintenance Procedures http://dogoro.us.oracle.com/wiki/index.php/Maintenance
<NOTE:1277396.1> - Sun x86 Platforms: Matrix of Recognized Device Paths
How to Replace a ZS4-4 PCIe Card: http://docs.oracle.com/cd/E56047_01/html/E56078/gowtv.html#scrolltoc
<NOTE:1985159.1> - Updating IB partitions after replacing an Infiniband HCA in any nodes within IB network - steps to do after replacing HCA
<NOTE:1435063.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot Infiniband Issues
<NOTE:1416406.1> - Sun ZFS Storage Appliances Troubleshooting Resource Center
<NOTE:2029161.1> - Oracle ZFS Storage Appliance: Procedure to Upgrade IB HCA Firmware in CLI

Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback