Infiniband Switch Replacement – Overview and guide to key articles

Asset ID:	1-79-2125242.1
Update Date:	2018-01-09
Keywords:

Solution Type Predictive Self-Healing Sure

Solution 2125242.1 : Infiniband Switch Replacement – Overview and guide to key articles

Applies to:

Sun Network QDR InfiniBand Gateway Switch - Version All Versions to All Versions [Release All Releases]
Sun Datacenter InfiniBand Switch 36 - Version All Versions to All Versions [Release All Releases]
Exadata Database Machine V2 - Version All Versions and later
Information in this document applies to any platform.

Purpose

Overview and guide to key documents used in Infiniband Switch Replacement

Scope

Replacement of Sun/Oracle Infiniband Switch, including NM2-GW and 36p, for all configurations except Exalogic (refer to Note box below)

Details

Note: For IB switches within an Exalogic system, use Doc ID 2223662.1 instead of this document.

NOTE: The backups and snapshots to be taken, as described in these KM documents, should be collected from all switches on the IB fabric that contains the switch under review (i.e., the switch to be replaced; e.g., a single "dead" switch).

Justification: in the course of replacing the switch under review, there could be unexpected/catastrophic event on other switches -- and the additional backups/snapshots could be used to recover the IB ENV with minimum downtime.

The following documents are used by Customer system administrators, on-site team and Oracle Support, during replacement of Oracle/Sun Infiniband Switches. Please follow the documents in sequence:

A. Preparation (covers preparation for all Oracle/Sun Infiniband Switches - follow these two documents in sequence):

Document	Purpose	Audience/Responsibility
How to Prepare an Infiniband (IB) Fabric for Planned Outage of an IB Switch (Doc ID 2140928.1)	Prepare an Infiniband (IB) Fabric, for any planned outage of an Infiniband Switch within that IB Fabric Checklist to assist Customer-admin to determine if a full Fabric outage will be required, based on the results of checks done	Audience: External Responsibility: Customer Admin
How to Prepare an Infiniband Switch for Replacement (Doc ID 1636229.1)	Prepare an Infiniband Switch for replacement. Collect information needed by Oracle Support / on-site team to prepare for a physical replacement.	Audience: External Responsibility: Customer Admin

B. Actual physical replacement by On-site team (use one of the following docs - dependent on the Switch part involved)

Document

Purpose

Audience/Responsibility

How to Replace a Failed Sun Network QDR InfiniBand Gateway Switch (Doc ID 1383773.1)

Replace a Sun Network QDR InfiniBand Gateway Switch (NM2-GW)

Audience: External

Responsibility: On-site team

How to Replace a Failed Sun Datacenter InfiniBand Switch 36 (Doc ID 1341658.1)

Replace a Sun Datacenter InfiniBand Switch 36 (NM2-36p)

Audience: External

Responsibility: On-site team

C. Required follow-up to restore the customer Fabric configuration (covers follow-up for all Oracle/Sun Infiniband Switches)

Document	Purpose	Audience/Responsibility
Infiniband Switch Replacement - Follow-up Actions (Doc ID 2125203.1)	Final reconfiguration steps in Infiniband Switch replacement. Required to be used after the on-site work described in How to Replace document above	Audience: External Responsibility: Customer Admin

In summary, please leverage the procedures above, in sequence, when replacing an Infiniband Switch.

References

<NOTE:1636229.1> - How to Prepare an Infiniband Switch for Replacement
<NOTE:2211261.1> - How to Prepare an Exalogic Infiniband (IB) Fabric for Planned Outage of an IB Switch
<NOTE:1341658.1> - How to Replace a Failed Sun Datacenter InfiniBand Switch 36
<NOTE:2125203.1> - Infiniband Switch Replacement - Follow-up Actions
<NOTE:1383773.1> - How to Replace a Failed Sun Network QDR InfiniBand Gateway Switch
<NOTE:2140928.1> - How to Prepare an Infiniband (IB) Fabric for Planned Outage of an IB Switch

Attachments

This solution has no attachment