How to Replace a SPARC T7-1, T7-2 or T7-4 PCIe NVMe Switch Card

Asset ID:	1-71-2084286.1
Update Date:	2017-11-15
Keywords:

Solution Type Technical Instruction Sure

Solution 2084286.1 : How to Replace a SPARC T7-1, T7-2 or T7-4 PCIe NVMe Switch Card

Applies to:

SPARC T7-2 - Version All Versions and later
SPARC T7-1 - Version All Versions and later
SPARC T7-4 - Version All Versions and later
SPARC

Goal

How to Replace a SPARC T7-1, T7-2 and T7-4 PCIe NVMe Switch Card

Solution

****************************************************************************************
To report errors or request improvements on this procedure, please add a comment on Doc ID: 2084286.1

****************************************************************************************

ESD Caution:

Circuit boards and drives contain electronic components that are extremely sensitive to static electricity. Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards. Do not touch the components along their connector edges.
Use a Antistatic Wrist strap. Attach one end of the strap to your wrist and the other end to the chassis, depending on what type of strap you use, with the adhesive end or the metal plug.
Use an Antistatic Mat. Place ESD-sensitive components such as motherboards, memory, and other PCBs on an antistatic mat.

Contamination Caution:

Dust particles of packaging material are number one cause of datacenter contamination. Make sure to remove all packaging material, up to the ESD safe packaging material, while still being outside the datacenter.

DISPATCH INSTRUCTIONS

WHAT SKILLS ARE REQUIRED?: No special skills required, Customer Replaceable Unit (CRU) procedure

Time Estimate: 30 minutes

Task Complexity: 0

REMOVAL/REPLACEMENT INSTRUCTIONS:

PROBLEM OVERVIEW: SPARC T7-1, T7-2 or T7-4 PCIe NVMe Switch Card Replacement

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:

DAMAGE ALERT: Perform a visual inspection of the replacement part to make sure that there are no damaged components, connectors, bent pins, damaged packages during shipping, etc). If the part is damaged, don't install it into the system, order a new part. Handle with caution and package carefully the return part to avoid any damages during shipping.

If the system is still up and functioning, the customer should perform an orderly and graceful shutdown of applications and OS. Then power off the server and remove the AC power cords from the system. A data backup is not a prerequisite but is a wise precaution.

NOTE: For ALL scenarios where an AC power down or AC power cycle is required for a T7-x server, please always use the steps in doc 1571054.1 prior to physically removing AC power cables from the server

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE?:

1. Prepare the server for service.

    a. Power off the server and disconnect the power cords from the power supplies.
    b. Extend the server to the maintenance position in the rack (SPARC T7-1 and SPARC T7-2 Only; SPARC T7-4 PCIe NVMe Switch Card(s) are located in either PCIE1 or PCIE2 (or both) on the main module FRU which can be accessed from the front of the SPARC T7-4 Server).
    c. Attach an anti-static wrist strap.

Replace the SPARC T7-1, T7-2 or T7-4 PCIe NVMe Switch Card

1. Since the PCIe NVMe Switch card is a PCIe card please see one of the following T7 CAPs (depending on which T7 system you have the NVMe Switch Card installed in):

   How to Replace a SPARC T7-1 PCIe Card (Doc ID 2083809.1)
   How to Replace a SPARC T7-2 PCIe Card (Doc ID 2084243.1)
   How to Replace a SPARC T7-4 PCIe Expansion Card/Carrier [VCAP] (Doc ID 1966601.1)

Very Important - In a SPARC T7-1 the NVMe Switch Card must be installed in PCIe Slot #3. It will not work in any other PCIe slot.

Note - The SPARC T7-4 PCIe NVMe Switch Card(s) are located in either PCIE1 or PCIE2 (or both) on the main module FRU which can be accessed from the front of the SPARC T7-4 Server. The PCIe NVMe Switch card cables need to plug into the disk backplane so these cards can never be installed in the PCIe slots in the back of the system.

2. Return the Server to operation.

    a. Remove any anti-static measures that were used.
    b. Return the server to it's normal operating position within the rack.
    c. Re-install the AC power cords and any data cables that were removed.
    d. Power on server. Verify that the Power/OK indicator led lights steady on.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE FE/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:
Boot system and monitor boot sequence for errors. Test functionality of system:
1. Run the Solaris "fmadm faulty" and SP/ILOM "show faulty" command to verify that the fault has been cleared.
2. Perform one of the following tasks based on your verification results:
   * If the previous steps did not clear the fault, refer to doc 1004229.1 for information about the tools and methods you can use to diagnose and clear
     component faults.
   * If the previous steps indicate that no faults have been detected, the component has been replaced successfully. No further action is required
3. Restart software applications per applicable administration guides to resume system operation.

PARTS NOTE:
https://support.oracle.com/handbook_private/Systems/SPARC_T7_1/components.html#I/O

https://support.oracle.com/handbook_private/Systems/SPARC_T7_2/components.html#I/O

https://support.oracle.com/handbook_private/Systems/SPARC_T7_4/components.html#I/O

REFERENCE INFORMATION:
SPARC T7-1 Service Manual: http://docs.oracle.com/cd/E54976_01/html/E54980/index.html
SPARC T7-2 Service Manual: http://docs.oracle.com/cd/E54983_01/html/E54987/index.html
SPARC T7-4 Service Manual: http://docs.oracle.com/cd/E54990_01/html/E54994/index.html

Attachments

This solution has no attachment