Big Data Appliance X3-2 Hardware
 
Exadata X4-2 Hardware
 
Exadata X3-2 Hardware
 
Exalogic Elastic Cloud X3-2 Eighth Rack
 
Oracle Exalogic Elastic Cloud Software
 
Exadata Database Machine X2-2 Qtr Rack
 
Big Data Appliance X4-2 Hardware
 
Exalogic Elastic Cloud X3-2 Half Rack
 
Exadata X5-2 Hardware
 
Exadata X4-8 Hardware
 
Big Data Appliance X5-2 Hardware
 
Exadata Database Machine X2-2 Full Rack
 
Exadata Database Machine X2-8
 
Exadata X3-8 Hardware
 
Exadata Database Machine X2-2 Half Rack
 
Sun Datacenter InfiniBand Switch 36
 
Zero Data Loss Recovery Appliance X4 Hardware
 
Zero Data Loss Recovery Appliance X5 Hardware
 
Big Data Appliance Hardware
 
Exalogic Elastic Cloud X3-2 Quarter Rack
 
Exadata Database Machine X2-2 Hardware
 
Exalogic Elastic Cloud X3-2 Full Rack
 
Exadata X3-8b Hardware
 
Sun Network QDR InfiniBand Gateway Switch
 
Exadata Database Machine V2
 
Oracle SuperCluster M6-32 Hardware
 
SPARC SuperCluster T4-4
 
Oracle SuperCluster T5-8 Hardware
 

PLA-Support>Sun Systems>Sun_Other>Sun Collections>SN-OTH: SaND-CAP VCAP
 

In this Document

Goal

Solution

References

Applies to:

Goal

Backing Up and Restoring Switch Settings for Sun Datacenter InfiniBand Switch 36

Solution

DISPATCH INSTRUCTIONS
- WHAT SKILLS DOES THE ENGINEER NEED:
Familiarity with the InfiniBand switch.

TIME ESTIMATE: 60 minutes

TASK COMPLEXITY: 0

FIELD ENGINEER INSTRUCTIONS:
- PROBLEM OVERVIEW
Collect backup configuration of the switch for later restoration of the configuration when required.

- WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?
The InfiniBand switch will need to be up, running and reachable.  For restoring the configuration to the switch, the firmware should be at the same level as when the backup configuration was collected.

- WHAT ACTION DOES THE ENGINEER NEED TO TAKE:

Ensure the customer has a valid backup

Backing up, restoring, and verifing the replacement switch is the customers responsibility.

Backing Up and Restoring Switch Settings

The procedure for backing up and restoring switch settings depends on the firmware on the switch. The 1.1.3-2 firmware has Integrated Lights Out Manager (ILOM) which provides back up and restore capability. The 1.0.1 firmware does not have ILOM. You can either upgrade to the 1.1.3-2 firmware and then use the procedure in "Backing Up Settings on a Switch with 1.1.3-2 and Later Firmware", or you can perform the backup and restore of individual files manually.

Backing Up Settings on a Switch with 2.2.x and Later Firmware

The following procedure describes how to back up a switch with 1.1.3-2 firmware, and later. The backup only needs to be done once after the switch has been initially configured with the right settings.

Navigate to the switch ILOM URL in a browser. For example: http://dbm002-iba.us.example.com.
Log in as the ilom-admin user. The default password is ilom-admin.
In ILOM Administration select the Configuration Management.
Select the Backup Operation and the Browser method.
Type in a Passphrase. This is used to encrypt sensitive information, such as user passwords, in the backup.
Click Run, and save the resulting XML file in a secure location.
Save the output from the version command.
Review output from ps -ef | grep open to determine if OpenSM subnet manager daemon is already running on this switch. It may be intentionally disabled and not be running if this is a multi-rack of 4 or more full-racks, or if its connected to an Exalogic.

If the switch is used in an Exadata Engineered system, please refer to the following document:
Exadata Database Machine Maintenance Guide
4.5.1 Backing Up and Restoring Switch Settings 

If the Intiniband switch is part of an Exalogic configuration please see the following document:
How to Prepare an Exalogic Infiniband Switch for Replacement (Pre-checks & Backup) (Doc ID 2218443.1)

Backing Up Settings on a Switch with 1.1.3-2 thru 2.1.x Firmware

The following procedure describes how to back up a switch with 1.1.3-2 firmware, and later. The backup only needs to be done once after the switch has been initially configured with the right settings.

1. Navigate to the switch ILOM URL in a browser. For example: http://dbm002-i1.us.example.com.
2. Log in as the ilom-admin user. The default password is ilom-admin.
3. Select the Maintenance tab.
4. Select the Backup/Restore tab.
5. Select the Backup operation and the Browser method.
6. Type in a passphrase. This is used to encrypt sensitive information, such as user passwords, in the backup.
7. Click Run, and save the resulting XML file in a secure location.
8. (1.1.3.2 firmware only) Do the following steps to back up the opensm.conf file:
• Log in to the Sun Datacenter InfiniBand Switch 36 switch as the root user.
• Use the scp command to copy the /etc/opensm/opensm.conf file, and save it with the backup XML file. This is necessary because the backup does not save the Subnet Manager configuration.
• If the switch is used in an engineered system, please refer to the following document:
  Oracle® Exadata Database Machine Maintenance Guide 12c Release 1 (12.1) E51951-13
         --> Backing Up Settings on a Switch with 2.1.3-4 Firmware
9. Save the output from the version command.
10. Review output from ps -ef | grep open to determine if OpenSM subnet manager daemon is already running on this switch. It may be intentionally disabled and not be running if this is a multi-rack of 4 or more full-racks, or if its connected to an Exalogic.

If the switch is used in an Exadata Engineered system, please refer to the following document:
Exadata Database Machine Maintenance Guide
4.5.1 Backing Up and Restoring Switch Settings

If the Intiniband switch is part of an Exalogic configuration please see the following document:
How to Prepare an Exalogic Infiniband Switch for Replacement (Pre-checks & Backup) (Doc ID 2218443.1)

Backing Up Settings on a Switch with 1.0.1 Firmware

The following procedure describes how to back up the settings on a switch with 1.0.1 firmware:

1. Log in to the switch as the root user. The default password is welcome1 or changeme.
2. Make copies of the following files:
• /etc/sysconfig/network-scripts/ifcfg-eth0 (network configuration)
• /etc/resolv.conf (DNS information)
• /etc/ntp.conf (NTP information)
• /etc/localtime (time zone information)
• /etc/opensm/opensm.conf (openSM settings)
• /etc/sysconfig/network (host name)
• /etc/hosts (hosts file information)
3. Run the hostname command and save the output, in case the host name is not set in the /etc/sysconfig/network file.
4. Save the passwords for the root and nm2user accounts.
5. Run the nm2version command and save the output.
6. Review output from ps -ef | grep open to determine if OpenSM subnet manager daemon is already running on this switch. It may be intentionally disabled and not be running if this is a multi-rack of 4 or more  full-racks, or if its connected to an Exalogic.

Restoring Settings on a Switch with 1.1.3-2 and Later Firmware

The following procedure describes how to restore the settings on a switch with 1.1.3-2 firmware, and later firmware:

1. Run the version command, and ensure that the switch is at the right firmware level. If not, then upgrade the switch to the correct firmware level.
2. Navigate to the switch ILOM URL in a browser. For example: http://dbm002-i1.us.example.com.
3. Log in as the ilom-admin user. The default password is ilom-admin.
4. Select the Maintenance tab.
5. Select the Backup/Restore tab.
6. Select the Restore operation and the Browser method.
7. Click Browse, and select the XML file that contains the switch configuration backup.
8. Type in the passphrase that was used during the backup.
9. Click Run to restore the configuration.
10. If the switch is used in an engineered system, please refer to the following document:
    Oracle® Exadata Database Machine Maintenance Guide 12c Release 1 (12.1) E51951-13
           -->Restoring Settings on a Switch with 2.1.3-4 Firmware
11. (1.1.3.2 firmware only) Do the following steps to copy the opensm.conf file:
• Log in to the Sun Datacenter InfiniBand Switch 36 switch as the root user.
• Use the scp command to copy the opensm.conf file to the /etc/opensm/opensm.conf location on the switch. The opensm.conf file was the file that was created during the backup.

     11.  If OpenSM was previously running prior to restore, then restart OpenSM from the switch CLI using the following commands:

   Ensure the smnodes is created as follows:

FabMan@infiniband36p->smnodes add {ip-address ipaddress ip-address ip-address}

   Verify all switches configured as Subnet Managers smnodes is correct:

FabMan@infiniband36p->smnodes list
FabMan@infiniband36p->disablesm
FabMan@infiniband36p->enablesm

     12.  If partitions were previously configured prior to restore, then resync the partitions by logging into the currently running Subnetmanager Master and doint the following:

Determine the current SM Master:

FabMan@infiniband36p-> getmaster

Login to the Subnet Manager Master and sync the partition information:

FabMan@infiniband36p-> smpartition start

FabMan@infiniband36p-> smpartition commit

FabMan@infiniband36p-> smpartition list active

On the newly resored switch:

FabMan@infiniband36p-> smpartition list active

Ensure the partition information is syncronized by verifiing the version_number is the same and all the partition information matches.

Restoring Settings on a Switch with 1.0.1 Firmware

The following procedure describes how to restore the settings to a switch with 1.0.1 firmware:

1. Log in to the switch as the root user. The default password is welcome1 or changeme.
2. Ensure that the switch is at the right firmware level. If not, then upgrade the switch to the correct firmware level.
3. Restore the following files from the backup:
• /etc/sysconfig/network-scripts/ifcfg-eth0 (network configuration)
• /etc/resolv.conf (DNS information)
• /etc/ntp.conf (NTP information)
• /etc/localtime (time zone information)
• /etc/opensm/opensm.conf (openSM settings)
• /etc/sysconfig/network (host name)
• /etc/hosts (hosts file information)
4. Restore the host name by adding a HOSTNAME=switch_host_name line to the /etc/sysconfig/network file, if not already present.
5. Restore the passwords of the root and nm2user users using the passwd command.
6. Restart the network services by running the following commands in the order shown:
• service network restart
• service ntpd restart
7. If OpenSM was previously running prior to restore, then restart OpenSM from the switch CLI using the following commands:
• disablesm
• enablesm

OBTAIN CUSTOMER ACCEPTANCE
- WHAT ACTION DOES THE CUSTOMER NEED TO TAKE TO RETURN THE SYSTEM TO AN OPERATIONAL STATE:

Verify that the InfiniBand switch is reachable from the network after restoration.

PARTS NOTE:

REFERENCE INFORMATION:
Sun Datacenter InfiniBand Switch 36 Documentation: http://download.oracle.com/docs/cd/E19197-01/index.html
Source document: Backing Up and Restoring Switch Settings in Oracle Exadata Database Machine Owner's Guide 11g Release 2 (11.2)
http://wd0338.oracle.com/archive/cd_ns/E13877_01/doc/doc.112/e13874/maintenance.htm#CHDIAEID

This solution has no attachment