Master Note For Exalogic Infiniband Switch Replacement – Overview and guide to key articles

Asset ID:	1-79-2223662.1
Update Date:	2017-12-20
Keywords:

Solution Type Predictive Self-Healing Sure

Solution 2223662.1 : Master Note For Exalogic Infiniband Switch Replacement – Overview and guide to key articles

Applies to:

Oracle Exalogic Elastic Cloud Software - Version 2.0.0.0.0 and later
Exalogic Elastic Cloud X3-2 Quarter Rack - Version X3 to X3 [Release X3]
Oracle Exalogic Elastic Cloud X2-2 Full Rack
Exalogic Elastic Cloud X4-2 Hardware
Exalogic Elastic Cloud X4-2 Half Rack
Oracle Solaris on x86-64 (64-bit)
Linux x86-64
Oracle Virtual Server x86-64

Purpose

This is Master Note which has Overview and guide to key documents used in Exalogic Infiniband Switch Replacement

Scope

Replacement of Sun/Oracle Infiniband Switch (NM2-GW & 36p) in Exalogic Engineered System.

Details

The following documents are used by Customer system administrators, on-site team and Oracle Support, during replacement of Oracle/Sun Infiniband Switches in Exalogic.

These documents have to be followed in same exact sequence as listed below.

___________________________________________________________________________________________________________________________________________________________________________________________________

A. Preparation of Exalogic Infiniband Switches for replacement - IB Fabric Validation, Pre-checks & Backup

Follow below two documents in sequence to complete IB fabric validation, pre-checks and backups:

DOCUMENT	PURPOSE	AUDIENCE/RESPONSIBILITY
<Note 2211261.1>: How to Prepare an Exalogic Infiniband (IB) Fabric for Planned Outage of an IB Switch	Prepare an Exalogic Infiniband (IB) Fabric, for any planned outage of an Infiniband Switch within that IB Fabric. Checklist to assist Customer-admin to determine if a full Fabric outage will be required, based on the results of checks done.	Audience: External Responsibility: Customer Admin
<Note 2218443.1>: How to Prepare an Exalogic Infiniband Switch for Replacement (Pre-checks & Backup)	Prepare an Exalogic Infiniband Switch for replacement. Collect information needed by Oracle Support / on-site team, take configuration backup's and complete pre-requisites to prepare for a physical replacement of Switch.	Audience: External Responsibility: Customer Admin

___________________________________________________________________________________________________________________________________________________________________________________________________

B. Physical Replacement of Switch by On-site Field team

Field team uses one of the following CAP docs depending on the Switch part involved.

DOCUMENT	PURPOSE	AUDIENCE/RESPONSIBILITY
<Note 1383773.1>: How to Replace a Failed Sun Network QDR InfiniBand Gateway Switch	Replace a Sun Network QDR InfiniBand Gateway Switch (NM2-GW)	Audience: External Responsibility: Onsite Field Team
<Note 1341658.1>: How to Replace a Failed Sun Datacenter InfiniBand Switch 36	Replace a Sun Datacenter InfiniBand Switch 36 (NM2-36p)	Audience: External Responsibility: Onsite Field Team

___________________________________________________________________________________________________________________________________________________________________________________________________

C. Follow-up action for restoring the Exalogic Infiniband Switch configuration

Follow steps in below listed document to restore the Switch configuration from backup's after replacement.

DOCUMENT	PURPOSE	AUDIENCE/RESPONSIBILITY
<Note 2218689.1>: Exalogic Infiniband Switch Replacement - Follow-up Actions (Restoration)	Restoration steps for restoring the Exalogic Infiniband Switch configuration after replacement. These steps have to be followed after the on-site Field work is completed.	Audience: External Responsibility: Customer Admin

___________________________________________________________________________________________________________________________________________________________________________________________________

In summary, please leverage the procedures above, in sequence, when replacing an Infiniband Switch in Exalogic racks.

INTERNAL ONLY - MANUAL RESTORATION FOR SWITCH AFTER REPLACEMENT

Attached is Replacing a Switch-no bkup.docx word document which has manual restoration steps for Switch replacement without Exabr backup.

Switch replacement steps to be followed from attached word document for usecase when configuration files of failed switch are available (via exalogs or manual backup)

Follow steps 1-6 under SECTION A
Follow steps 7-10 under SECTION B
Follow Step "11. USE CASE: BACKUP NOT AVAILABLE AND EXALOGS AVAILABLE" under SECTION C
Follow Steps 13-14 under SECTION D
Follow Steps 15 & 16 under SECTION E. Skip Step 17 under SECTION E
Follow Steps 18-20 under SECTION F

Switch replacement steps to be followed from attached document for usecase when no backup is present at all for the failed switch

Follow steps 1-6 under SECTION A
Follow steps 7-10 under SECTION B
Follow Step "12. USECASE: NO BACKUP AT ALL (NO EXABR BACKUP AND NO EXALOGS BUNDLE)" under SECTION C
Follow Steps 13-14 under SECTION D
Follow Step 15 & Step 17 under SECTION E. Skip Step 16 under SECTION E
Follow Steps 18-20 under SECTION F

References

<NOTE:2218443.1> - How to Prepare an Exalogic Infiniband Switch for Replacement (Pre-checks & Backup)
<NOTE:2211261.1> - How to Prepare an Exalogic Infiniband (IB) Fabric for Planned Outage of an IB Switch
<NOTE:1341658.1> - How to Replace a Failed Sun Datacenter InfiniBand Switch 36
<NOTE:2236571.1> - FAQ: Exalogic NM2 Gateway Switch SSD Disk IS At End Of It's Life, Need To Know What Is Stored On This SSD Disk ?
<NOTE:2218689.1> - Exalogic Infiniband Switch Replacement - Follow-up Actions (Restoration)
<NOTE:1383773.1> - How to Replace a Failed Sun Network QDR InfiniBand Gateway Switch

Attachments

This solution has no attachment

Applies to:

Purpose

Scope

Details

A. Preparation of Exalogic Infiniband Switches for replacement - IB Fabric Validation, Pre-checks & Backup

<Note 2211261.1>: How to Prepare an Exalogic Infiniband (IB) Fabric for Planned Outage of an IB Switch

<Note 2218443.1>: How to Prepare an Exalogic Infiniband Switch for Replacement (Pre-checks & Backup)

B. Physical Replacement of Switch by On-site Field team

<Note 1383773.1>: How to Replace a Failed Sun Network QDR InfiniBand Gateway Switch

<Note 1341658.1>: How to Replace a Failed Sun Datacenter InfiniBand Switch 36

C. Follow-up action for restoring the Exalogic Infiniband Switch configuration

<Note 2218689.1>: Exalogic Infiniband Switch Replacement - Follow-up Actions (Restoration)

References