Pillar Axiom Replication Engine (MaxRep)
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: DISK-CAP VCAP
 

Instructions on how to replace a Controller PCIe (Peripheral Component Interconnect Express) Card in an FS1-2.

In this Document

Goal

Solution

References

Applies to:

Goal

The purpose of this document is to outline the steps required to replace a MaxRep3 Engine PCIe Card.

Solution

DISPATCH INSTRUCTIONS

- WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED:

Product knowledge, FS1-2 Flash Storage System, MaxRep3

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 0

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW:

What: A MaxRep3 Engine PCIe Card has failed and needs to be replaced.  PCIe Cards are plugged into a Riser which is then plugged into the motherboard.  PCIe Cards can be SAS HBA connections to internal drives, Fibre Channel or network HBAs for connections to data hosts.

Where: There will be a Hardware Status of "failed" in the MaxRep3 User Interface.

WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?

The MaxRep3 Engine with the PCIe Card failure will have a warning status.

Since the replacement HBA will have new port WWNs, the sql database and switch zoning will need to be updated to reflect this change.  This document will only cover the former as it is internal to the MaxRep3 Engine.  The port WWNs can be found on the circuit side of the HBA opposite the physical fibre channel ports themselves.

QRC for this procedure:

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE:

1. Prepare the MaxRep3 Engine for the Service Procedure.
1. Using the ILOM interface, confirm the failed part and location:
• Using a Browser: point a browser at the ILOM IP address and select Open Problems in the navigation tree on the left.
• Using the CLI: ssh to the ILOM IP address and execute "show /System/Open_Problems"
2. Disable Call-Home to prevent spurious alerts (see <Document 1942676.1> FS System: How to Disable Call-Home to Prevent Automatic Service Request (ASR) Generation).
3. Shutdown the MaxRep3 Engine (see <Document 2066803.1> MaxRep: How to Perform a Graceful Shutdown of the Oracle MaxRep3 Engine).
4. Use ESD precautions.
   
   
2. Access the failed PCIe Card.
1. Deploy the anti-tip legs in the front of the rack.
2. Slide the MaxRep3 Engine into the service position.
3. Unplug both power cords.
4. Loosen the two captive screws in the rear of the Top Cover.
5. Slide the Top Cover back and remove.
6. There are 3 Risers in each MaxRep3:
1. Riser 1 is next to the power supplies and contains slots 1 and 4.
2. Riser 2 is in the middle and contains slots 2 and 5.
3. Riser 3 is on the left and contains slots 3 and 6.
7. Unplug any external cables connected to the HBA(s) in the Riser that contains the failed PCIe Card - suggest the cables be labeled to make reconnection easier.
   
   
3. Remove the failed PCIe Card.
1. Loosen the two captive screws that secure the Riser to the motherboard and then lift the Riser and HBA(s) clear of the MaxRep3 Engine chassis.
2. If the failed Riser is #3, push down on the green tab to release the PCIe Card retainer and rotate it up 180 degrees to free it's PCIe Cards.
3. After noting which Riser slot the failed HBA is located in (bottom slots are 1-3, upper slots 4-6), remove it from the Riser.  HBA(s) must be returned to the same slots they came from.
   
   
4. Install the replacement PCIe Card.
1. Be sure to get the Port WWNs off of the rear circuit side of the new HBA.
2. Insert the replacement PCIe CARD removed in step 3-c into the same slot in the Riser.
3. If Riser #3 was removed, lock the PCIe Card retainer back in place.
4. Install the Riser back into the motherboard.
5. Secure the Riser and HBA(s) in place using the 2 captive screws.
   
   
5. Reassemble MaxRep3 Engine components.
1. Reconnect any external cables to the same HBA(s) as they were removed from in step 2-g.
2. Close the Top Cover.
3. Tighten the two captive screws in the rear of the Top Cover.
   
   
6. Return MaxRep3 Engine to the rack position.
1. Plug in both power cords.
2. Return the MaxRep3 Engine to the rack position.
3. Return the anti-tip legs to their normal position.
   
   
7. Contract Oracle Support to update the sql database in the MaxRep3 Engine with the new port WWNs.
   1. Download the replace_ports.php script attached to this document.
   2. Using WinSCP (or similar program) copy the script to the Active Control Service MaxRep3 Engine into /home/svsystems/admin/web.
   3. Adjust the permissions:
      # chmod 755 replace_ports.php
      #
       
   4. Obtain the MaxRep3 Engine GUID:
      # cat /home/svsystems/etc/amethyst.guid
      1ba45d84-5847-4e7f-8bfd-a1d2b98f2400
      #
       
   5. Obtain the Port WWNs of the old HBA from the HBA itself so that the sql database can be updated.
   6. Execute the replace_ports.php script using arguments of the GUID and Port WWNs:
      
      php replace_ports.php "GUID" "Old Port 0 WWN=New Port 0 WWN" "Old Port 1 WWN=New Port 1 WWN";
       
      Example:
      
      # php replace_ports.php "1ba45d84-5847-4e7f-8bfd-a1d2b98f2400" "21:00:00:24:ff:4e:21:1a=21:00:00:24:ff:4a:8a:50" "21:00:00:24:ff:4e:21:1b=21:00:00:24:ff:4a:8a:51";
      php: /lib64/libz.so.1: no version information available (required by /usr/lib64/libxml2.so.2)
      15616 Time : 2016-01-11 07:35:26 :: Ports needs to be updated are is Array
      (
          [21:00:00:24:ff:4e:21:1a] => 21:00:00:24:ff:4a:8a:50
          [21:00:00:24:ff:4e:21:1b] => 21:00:00:24:ff:4a:8a:51
      )
      
      15616 Time : 2016-01-11 07:35:47 :: Successfully updated all ports...
      #
       
      
      NOTE: script and the associated arguments must be executed from a single line.  Script must also be run from /home/svsystems/admin/web.
       
      
   7. Confirm successful update:
      # tail /home/svsystems/var/cs_migration.log
      Time : 2016-01-11 07:35:47 :: Successfully updated all ports...
8. Update switch zoning if using soft zoning (using pWWNs instead of physical switch ports).
9. Reboot MaxRep3 Engine.
10. Re-enable CallHome on the FS1-2 and or Axiom systems.

OBTAIN CUSTOMER ACCEPTANCE

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

Confirm that the replacement PCIe card was successful - the System Alert associated with it should be gone and the MaxRep3 Engine and FS1-2 should be normal/green.

Note: because the MaxRep3 Engine must cold start, it may take as long as 15 minutes for the boot process to complete and the MaxRep3 Engine to return to a normal status.

REFERENCE INFORMATION:

 From the Oracle Help Center: select the Oracle Flash System Utilities, Oracle MaxRep for SAN Documentation Library Release 3.0 for more information.

This solution has no attachment