How to Replace a Cisco ethernet switch in an Engineered Systems rack [VCAP]

Asset ID:	1-71-1531203.1
Update Date:	2017-08-22
Keywords:

Solution Type Technical Instruction Sure

Solution 1531203.1 : How to Replace a Cisco ethernet switch in an Engineered Systems rack [VCAP]

Applies to:

Oracle Exalogic Elastic Cloud X2-2 Qtr Rack - Version X2 and later
Exalogic Elastic Cloud X3-2 Half Rack - Version X3 and later
Exalogic Elastic Cloud X3-2 Quarter Rack - Version X3 and later
SPARC SuperCluster T4-4 Half Rack - Version All Versions and later
SPARC SuperCluster T4-4 Full Rack - Version All Versions and later
Information in this document applies to any platform.

Goal

How to Replace a Cisco ethernet switch in an Engineered Systems rack

Solution

DISPATCH INSTRUCTIONS WHAT SKILLS DOES THE FIELD ENGINEER/ADMINISTRATOR NEED?: Exadata trained
TIME ESTIMATE: 240 Minutes
TASK COMPLEXITY: 3

FIELD ENGINEER/ADMINISTRATOR INSTRUCTIONS:

PROBLEM OVERVIEW:
WHAT STATE SHOULD THE SYSTEM BE IN TO BE READY TO PERFORM THE RESOLUTION ACTIVITY?:

Configuration information should already be backed up if possible. If not, and the switch is still functional enough they can be backed up before replacement. If the switch is not functional enough the customer should have the original configuration information available for reconfiguring.

Note: There are specific Serial Number (SN) tracking requirements for CISCO, please review the note in section 2, prior to replacing the switch.

Recommended tools – Phillips #2 or #3 Long-shaft screwdriver, with shaft ~400mm (~16”) for access to rack rail screws. A magnetic or claw tip to hold the screws for retrieval during in-rack removal is recommended, or place a temporary tray below the switch for catching them.

Note - a PDF version of this CAP document is available for offline use, attached to this document in MOS.

WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE?:

Backup the configuration.
1. If the configuration has not been backed up already, and the switch can still communicate with the network, then do so as follows:
  1. If there is not already one configured on the local subnet, configure a TFTP server to send the configuration files to. Note the tftp root directory (usually /tftpboot) requires world write permission.
  2. Login to the switch and enter privileged “enable” mode:
    
    exa1sw-ip> enable
    
    exa1sw-ip#
  3. Determine the current version of IOS software release:
    
    exa1sw-ip# show version
    Cisco IOS Software, Catalyst 4500 L3 Switch Software (cat4500-IPBASE-M), Version 12.2(53)SG1, RELEASE SOFTWARE (fc1)
    …
    
    The first line of output provides the type of firmware and version. Write this down for later use.
    - IPBASE is telnet-only IOS
    - IPBASEK9 is SSH enabled IOS
  4. Run the following:
    
    exa1sw-ip# copy running-config tftp:
    Address or name of remote host []? 192.168.1.254
    Destination filename [exa1sw-ip-confg]? <Press Enter to accept default, or enter a filename>
    !!
    5450 bytes copied in 0.952 secs (5734 bytes/sec)
    exa1sw-ip#
  5. Open the configuration file logged with a text editor. Search for and remove any line that starts with "AAA". Also remove the leading version, configuration and any comment (!) lines.
    
    Note: This step is to remove any security commands that can lock you out of the switch. Reference the following document for more information:
    http://www.cisco.com/en/US/products/sw/iosswrel/ps1835/products_tech_note09186a008020260d.shtml
    
    For example:
    
    Before:
    
    Current configuration : 5594 bytes
    !
    version 15.0
    no service pad
    service timestamps debug datetime msec
    service timestamps log datetime msec
    no service password-encryption
    service compress-config
    !
    hostname exa1sw-ip
    !
    boot-start-marker
    boot system bootflash:cat4500e-ipbasek9-mz.150-2.SG4.bin
    boot-end-marker
    !
    enable secret 5 $1$mR3P$sGPs5KtYfqC6R63PpFlDq
    enable password welcome1
    !
    username admin password 0 welcome1
    !
    aaa new-model
    !
    !
    !
    aaa session-id common
    clock timezone EST -5
    ...
  6. After:
    
    no service pad
    service timestamps debug datetime msec
    service timestamps log datetime msec
    no service password-encryption
    service compress-config
    hostname exa1sw-ip
    boot-start-marker
    boot system bootflash:cat4500e-ipbasek9-mz.150-2.SG4.bin
    boot-end-marker
    enable secret 5 $1$mR3P$sGPs5KtYfqC6R63PpFlDq
    enable password welcome1
    username admin password 0 welcome1
    clock timezone EST -5
    ...
2. If the configuration cannot be saved due to the switch network not responding, then use a terminal access to the serial console port to get a dump of the running configuration.
  1. Start a terminal program that is able to log all output to a local text file, e.g script followed by ‘tip’, or ‘PuTTY’
  2. At the regular switch prompt, enter privileged “enable” mode:
    
    exa1sw-ip> enable
    
    exa1sw-ip#
  3. Issue the "terminal length 0" command in order to force the router to return the entire response at once, rather than one screen at a time. This allows you to capture the configuration without extraneous --more-- prompts generated when the router responds one screen at a time.
  4. Determine the current version of IOS software release:
    
    exa1sw-ip# show version
    
    Cisco IOS Software, Catalyst 4500 L3 Switch Software (cat4500-IPBASE-M), Version 12.2(53)SG1, RELEASE SOFTWARE (fc1)
    …
    
    The first line of output provides the type of firmware and version. Write this down for later use.
    - IPBASE is telnet-only IOS
    - IPBASEK9 is SSH enabled IOS
  5. Issue the "show running-config" command, and allow time for the router to complete its response. You will see:
    
    exa1sw-ip# show running-config
    Building configuration...
    
    followed by the configuration output dumped to the terminal.
  6. Open the configuration file logged with a text editor. Search for and remove any line that starts with "AAA".
    Note: This step is to remove any security commands that can lock you out of the switch. Reference the example above in section 1 (a) (v).
  7. Save the file.
3. If the IOS version cannot be determined, and the configuration cannot be saved due to the Switch not responding to local serial console or network, then the following information is required to manually restore the minimum configuration similar to a new installation:
  1. Switch Hostname
  2. Switch IP address, gateway, subnet mask
  3. DNS information
  4. NTP and timezone information
Physically remove and replace the switch.

Note: The CISCO switch is a SupeFRU and requires that the Serial Number (SN) be captured and the Install Base updated when replaced. The correct nomenclature of a Cisco 4948 serial number is either a "CAT" or "FOX" prefix followed by 4 numeric and 4 alpha characters (for example :- CAT2034SFVW or FOX1531H0DR).

If you cannot get the serial number of the replacement unit by a physical inspection prior to installation, see post-replacement step 5 below for how to obtain it from the firmware.

There are 2 alternative methods outlined below. Neither method requires complete shutdown of the rack or rack side-panel access to complete. Each method is detailed in the attached documents:

A. Replacement through Front of Rack

This method does not require any actions on the servers, or shutdown of any other rack components.
This method requires either a short-shaft Phillips #1 screwdriver with shaft no longer than 82mm (3.25”) or a screwdriver with ratcheting right-angled head and Phillips #1 tip with overall width no longer than 82mm (3.25”), to fit the space between side-panel and screw.

A video of this physical procedure is available on OTube - https://otube.oracle.com/media/Cisco+Switch+Replacement+Through+Front+of+Rack/0_dufuecox
1. Remove the front vented filler from the rack for both the Cisco switch and the filler above and below if any, for improved hand access.
2. Reach in from the front of the rack and press off the AC power supply switches, and unplug the AC power cords from each power supply and put aside.
3. (Optional) On racks with the Cisco switch installed in between 2 InfiniBand (IB) switches, it may be preferable to carefully undo and remove the rear cable arm for the upper IB switch first, to allow easier hand access from above. Do NOT unlatch and remove any IB cables from servers, keep them plugged into the IB switch to ensure they remain in the IB switch 1U rack space and do not interfere with the Cisco switch moving. This does not and should not require the IB switch to be shut down
  
  After removing the rear cable arm, also remove on the left side the cable arm bracket and re-secure the IB switch rail to the rack.
  
  Optionally remove the right side cable arm bracket as well and re-secure the IB switch rail to the rack, to provide easier access to the screws securing the Cisco switch to the rack.
  
  If available, a Phillips #3 screwdriver with a long-shaft (16-inch / 400mm or longer) will make it easier for removing the screws attaching the switch to the rack.
4. (Optional) On racks with systems installed directly above the Cisco switch and its adjacent IB switch, it is also recommended to slide 1 or 2 systems out to the front of the rack such that the cable management arms and cabling are out of the way, to provide better hand and tool access from above. This does not and should not require the systems to be shut down.
5. Unplug the cables from the Cisco switch:
  1. Unplug the customer’s network cable from port 48 and put out of the way. Ensure it is clearly identifiable if not labeled.
  2. Unplug the RJ45 network cables from the switch ports and pull as a bundle either up, down or to the right as far out of the way as possible.
  3. Remove the serial port console cable from the “Con” port. On 4948 this is to the left of the SFP+ ports. On 4948E-F this is to the right of the SFP+ ports.
6. Unplug the RJ45 network cable plugged into the upper IB leaf switch Net0 port, and move that to the side with the rest of the bundle.
7. Remove the switch physically. This may take some time and patience.
  1. Remove the screws holding the switch mounting ears to the rack vertical rails. If available, a Phillips #3 screwdriver with a long-shaft (16-inch / 400mm or longer) will make it easier for removing the screws attaching the switch to the rack.
  2. On all racks, except Exalogic Eighth, Quarter and Half-Racks:
    Carefully maneuver the switch toward the rear of the rack and angle it as much as possible to the right such that the side screws on the left-side mounting ear are accessible.
    
    With a short shaft, or right-angled ratcheting Phillips #1 screwdriver (from side-panel to screw, the screwdriver shaft must be 76mm or 3” or shorter), undo the 4 flush mount screws that hold the left or right rack mounting ear.
    
    On the Cisco 4948 the screws are directly behind the mounting ear. On the Cisco 4948E-F the screws are 30mm (1.25”) behind the mounting ear. On the Cisco 4948, be careful not to undo the 2 pan head screws that go into the chassis and do not hold the rack mounting ear at all. Refer to the photos attached to the MOS Note for this CAP for the correct locations.
    
    Tip 1: The screw locations may not easily be visible and may need to be identified by feel to get the screwdriver tip into the screw head. They should be hand tight and not require a lot of torque to start. It may be preferred to finger loosen them once the screw is partially loosened.
    
    Tip 2: Take care to remove the screws by hand, magnetic tip or screw grabbing tip, or place a temporary tray under the bracket to catch the screws so they do not fall into the rack and cabling.
    
    On Exalogic Eighth, Quarter and Half-Racks only:
    On these racks, the Cisco switch is mounted in a location that nothing supports it from below, so it is mounted with extended support brackets to the front of the rack that hold it in its 1U space. On these racks only, remove the extended bracket slides from the front of the rack. The switch will dip down slightly from its weight but will stay supported from the rear mounting screws. The left side mounting ear does not need to be removed.
  3. On all racks, except Exalogic Eighth, Quarter and Half-Racks:
    Once the left side mounting ear is removed from the switch, carefully maneuver the switch out of the rack, sliding it towards the front. Angle and maneuver the right-side switch ear past the rear rack rail, then continue pulling it from the front of the rack, angling the right-side switch ear past the front rack rails until it is completely removed from the rack.
    
    On Exalogic Eighth, Quarter and Half-Racks only:
    Carefully maneuver the switch out of the rack towards the front. On these racks, the Cisco switch can be angled into the space above and below the switch mounting space to maneuver the mounting ears past the rear and front rack rails until it is completely removed from the rack.
8. Remove the 2^nd AC power supply and Fan Tray from the original switch, and re-install them in the new switch.
9. Migrate the rack mounting ears (and extended slide brackets if applicable) that were left on the original switch, re-installing them in the same locations on the new switch.
  
  When installing from the front of the rack, only one mounting ear can be installed outside of the rack, the second mounting ear must be installed on the inside rear of the rack, reversing the process used above. It is preferable to finger start the flush mount screws as much as possible before using a screwdriver to tighten.
10. Install the new switch physically, reversing the above removal steps.
  Take note of the Serial Number of the replacement switch prior to installing into the rack, as this will be required for install base updates.
B. Replacement through Rear of Rack

This method requires shutdown of the InfiniBand (IB) switch located directly above the Cisco switch, except in Exalogic Eighth, Quarter and Half Racks.
This method requires no special tools.

A video of this physical procedure is available on OTube - https://otube.oracle.com/media/Cisco+Switch+Replacement+through+Rear+of+Rack/0_fur2usfw
1. Preparation: Run 'ibstat' on all connected servers to ensure both InfiniBand (IB) ports are up before starting, so that all servers maintain an IB connection when the IB switch is powered off in step 3. Failure to verify this may cause an IB outage on one host which may in turn lead to an application outage.
2. Remove the front vented filler from the rack for both the Cisco switch and the filler above and below if any, for improved hand access.
3. Reach in from the front of the rack and press off the AC power supply switches, and unplug the AC power cords from each power supply and put aside.
4. All racks except Exalogic Eighth, Quarter and Half Racks, power off the IB switch directly above the Cisco switch by removing the AC power cables from the front of the switch.
5. (Optional; not applicable to Exalogic Eighth, Quarter and Half Racks) Carefully undo and remove the rear cable arm for the IB switch directly above the Cisco switch, to allow easier hand access from above. Do NOT unlatch and remove any IB cables from servers, keep them plugged into the IB switch to ensure they remain in the IB switch 1U rack space and do not interfere with the Cisco switch moving. This does not and should not require the IB switch to be shut down.
  
  After removing the rear cable arm, also remove on the left side the cable arm bracket and re-secure the IB switch rail to the rack.
  
  Optionally remove the right side cable arm bracket as well and re-secure the IB switch rail to the rack, to provide easier access to the screws securing the Cisco switch to the rack.
  If available, a Phillips #3 screwdriver with a long-shaft (16-inch / 400mm or longer) will make it easier for removing the screws attaching the switch to the rack.
6. (Optional; not applicable to Exalogic Eighth, Quarter and Half Racks) On racks with systems installed directly above the Cisco switch and its adjacent IB switch, it is also recommended to slide 1 or 2 systems out to the front of the rack such that the cable management arms and cabling are out of the way, to provide better hand and tool access from above. This does not and should not require the systems to be shut down.
7. All racks except Exalogic Eighth, Quarter and Half Racks, remove the 8 Inter-switch IB cables from the IB switch directly above the Cisco switch, and swing them down so they are out of the way.
8. Unplug the cables from the Cisco switch:
  1. Unplug the customer’s network cable from port 48 and put out of the way. Ensure it is clearly identifiable if not labeled.
  2. Unplug the RJ45 network cables from the switch ports and pull as a bundle either up, down or to the right as far out of the way as possible.
  3. Remove the serial port console cable from the “Con” port. On 4948 this is to the left of the SFP+ ports. On 4948E-F this is to the right of the SFP+ ports.
9. Unplug the RJ45 network cable plugged into the Net0 port on the IB switch directly above the Cisco switch, and move that to the side with the rest of the bundle.
10. On Exalogic Eighth, Quarter and Half Racks Only:
  On these racks, the Cisco switch is mounted in a location that nothing supports it from below, so it is mounted with extended support brackets to the front of the rack that hold it in its 1U space. On these racks only, remove the extended bracket slides from the front of the rack. The switch will dip down slightly from its weight but will stay supported from the rear mounting screws.
11. Remove the switch physically. This may take some time and patience.
  1. Undo the 4 screws(2 per side) holding it to the rear mounting point. If available, a Phillips #3 screwdriver with a long-shaft (16-inch / 400mm or longer) will make it easier for removing the screws attaching the switch to the rack.
  2. On racks with an IB switch directly below the Cisco switch, untie the cables running across the top of the IB switch cable arm, and remove the top bar of the IB cable arm so it does not interfere with sliding out the Cisco switch. Alternatively, if the rack does not have systems below the IB switch so there is available space, carefully undo the IB cable arm assembly from the cable arm brackets, and lower it 5 to 10mm so it does not interfere with sliding out the Cisco switch. Do NOT unplug the IB cables from the IB switch.
  3. Carefully maneuver the switch out of the rack, sliding it towards the rear and working the mounting ears around the IB cable bundles and power cords until it is completely removed from the rack. On Exalogic Eighth, Quarter, and Half Racks, the switch will need to be angled using the space above and below the switch to get the extended slide brackets past the rear vertical rack rails.
12. Remove the 2^nd AC power supply and Fan Tray from the original switch, and re-install them in the new switch.
13. Migrate the rack mounting ears (and extended slide brackets if applicable) that were left on the original switch, re-installing them in the same locations on the new switch.
14. Install the new switch physically, reversing the above steps.
  Take note of the Serial Number of the replacement switch prior to installing into the rack, as this will be required for install base updates.
  
  Take caution when maneuvering the switch into the rack that the pull tabs for the IB cables going to the servers that remained in the IB switch above, make sure they do not get stuck between the switches as they may break. Lift them up to sit on top of the Cisco switch chassis as it is sliding in.
After replacement using one of the two methods detailed above, continue with the steps below.
Connect a laptop or other terminal device to the serial console, and verify the new switch boots up. It may take up to a minute to boot.
Oracle requires all switch replacements to be upgraded to use the SSH-enabled IOS however FRU replacement switches may not arrive upgraded. Determine the Cisco IOS version of the replacement switch:

Switch> show version
Cisco IOS Software, Catalyst 4500 L3 Switch Software (cat4500-IPBASE-M), Version 12.2(53)SG1, RELEASE SOFTWARE (fc1)
…

The first line of output provides the type of firmware and version. Write this down for later use.
- IPBASE is telnet-only IOS
- IPBASEK9 is SSH enabled IOS
If you were unable to get the serial number of the replacement unit by a physical inspection prior to installation, please run the following command on the switch to display the serial number after installation:
Switch> show idprom supervisor
Restore the original configuration and update the IOS firmware if necessary, based on the information gathered in step 1 and 15.
1. If the original switch used IPBASE IOS, and the new switch uses IPBASE IOS then restore the configuration first, then upgrade the firmware to the SSH enabled IOS.
2. If the original switch used IPBASE IOS, and the new switch uses IPBASEK9 IOS then restore the configuration, but take care not to change any “boot” section fields, for example:
  
  boot-start-marker
  boot system bootflash:cat4500e-ipbasek9-mz.150-2.SG4.bin
  boot-end-marker
  
  If there are any issues with configuration on the new firmware, then check with the TSC Network engineer assigned to the SR for assistance.
3. If the original switch used IPBASEK9 IOS and the new switch uses IPBASE IOS then upgrade the firmware to the SSH enabled IOS first, then restore the configuration.
4. If the original switch used IPBASEK9 IOS and the new switch uses IPBASEK9 IOS then restore the configuration. Check with the TSC Network engineer assigned to the SR if there is a newer IOS than the one on the FRU replacement to load prior to handing back to the customer.
5. If the original switch had a specific customer-installed IOS version, then check with the customer about installing their IOS version first, then restore the configuration.
Restoring the configuration:

Enter privileged “enable” mode and restore the configuration using one of the following methods:

Switch> enable

Switch#
1. If the backup was done using the network ftp server as described in step 1a, use the following:
  1. Copy the saved configuration file from the tftp server:
    Switch# copy tftp: running-config
    Address or name of remote host []? 192.168.1.254
    Source filename []? exa1sw-ip-confg
    Destination filename [running-config]? <Hit Enter>
    Accessing tftp://192.168.1.254/exa1sw-ip-confg ...
    Loading exa1sw-ip-confg from 192.168.1.254 (via GigabitEthernet1/48): !
    [OK - 5450 bytes]
    5450 bytes copied in 1.052 secs (5400 bytes/sec)
    exa1sw-ip#
  2. Verify the settings are correct:
    
    exa1sw-ip# show running-config
  3. Copy the running configuration to the startup configuration:
    
    exa1sw-ip# copy running-config startup-config
2. If the backup was done using the terminal output log as described in step 1b, use the following:
  1. Open the terminal output log file with the configuration information, highlight the entire file output and copy it to the clipboard of the terminal's OS
  2. Enter the terminal configuration of the switch:
    
    Switch# config terminal
  3. Paste the file output from the clipboard of the OS to the switch command line.
    IMPORTANT: You must hit enter for the last command to ensure it is completed!
  4. After the configuration input has completed pasting and brings you back to the switch enable prompt, verify the settings are correct:
    
    exa1sw-ip# show running-config
  5. Copy the running configuration to the startup configuration:
    
    exa1sw-ip# copy running-config startup-config
3. If the backup was done using the minimum configuration as described in step 1c, then restore the minimum configuration manually doing the factory settings followed by the EIS settings, as follows:
  1. Enter the terminal configuration of the switch:
    
    Switch# config terminal
  2. Set spanning-tree off for all the ports except the customer uplink port 48:
    
    Switch(config)# interface range gigabitethernet 1/1 – 47
    Switch(config-if)# spanning-tree portfast
    Switch(config-if)# end
    
    Note when specifying the range command, the spaces on either side of the dash are required.
  3. Set media-type for the shared RJ45 and SFP+ ports 45 to 48, to use the RJ45 ports:
    
    Switch(config)# interface range gigabitethernet 1/45 – 48
    Switch(config-if)# media-type rj45
    Switch(config-if)# end
  4. Configure the rest of the settings for IP, hostname, DNS, NTP/Clock, SSH key/account and spanning tree following the steps in the EIS checklist for the appropriate Engineered System.
    http://eis.us.oracle.com/checklists/checklists.html
Upgrading the Firmware:

For specific details follow MOS Note 1415044.1. The latest firmware files required are available from the TSC Network engineer assigned to the SR. Before rebooting to the new IOS, ensure the following is set:

Switch# boot system bootflash:cat4500-ipbasek9-mz.150-2.SG4.bin

where “cat4500-ipbasek9-mz.150-2.SG4.bin” is the name of the bin file that was loaded. The actual version and file string may vary from this example.
Reboot the switch with the “reload” command and ensure that it boots and runs the version flashed, by running “show version” after logging in.

Switch# reload
Proceed with reload? [confirm]
… <boot messages> …

Press RETURN to get started!

Switch>show version

Cisco IOS Software, Catalyst 4500 L3 Switch Software (cat4500-IPBASEK9-M), Version 15.0(2)SG4, RELEASE SOFTWARE (fc1)

Technical Support: http://www.cisco.com/techsupport

Copyright (c) 1986-2012 by Cisco Systems, Inc.

Compiled Mon 19-Mar-12 15:11 by prod_rel_team

Image text-base: 0x10000000, data-base: 0x1208DAFC

ROM: 12.2(31r)SGA2

Dagobah Revision 226, Swamp Revision 5

exa1sw-ip uptime is 9 weeks, 5 days, 22 hours, 3 minutes

System returned to ROM by power-on

System restarted at 13:06:19 EDT Thu Aug 23 2012

System image file is "bootflash:cat4500-ipbasek9-mz.150-2.SG4.bin"

...

OBTAIN CUSTOMER ACCEPTANCE WHAT ACTION DOES THE FIELD ENGINEER/ADMINISTRATOR NEED TO TAKE TO
RETURN THE SYSTEM TO AN OPERATIONAL STATE:

Verify with the customer that the settings restored are ok and that its ok to re-connect the customer’s network cable to port 48.
Connect the customer’s network cable to port 48.
Verify from the console that the switch can ping the customer network gateway.
Verify with the customer that they are able to ping and/or access each of the rack nodes over the management network.
Update Install Base records, to ensure that the replacement-part serial# will be properly entitled. Within Oracle, the Cisco Switch is termed a "SuperFRU" which simply means that it is a whole chassis replacement including both chassis and internal main-board. Therefore, follow the relevant SuperFRU procedure:
a. If the Cisco Switch has been replaced by Oracle field engineer, then the Oracle FE should use the process in the internal Oracle Global Desk Manual repository, "Field Delivery & Logistics Desk Manual" section, "Field Service Engineer / Procedures" here:
https://ptp.oraclecorp.com/pls/apex/f?p=151:106:11216637699057::::DL,DV,DP,DJ:161,2065,2,0
and click on the relevant WFS or FSTP procedure for "Performing Material Debrief on SPARC board or SuperFRU".
b. Partners will use the process they already use.

PARTS NOTE:

371-4784 Cisco Catalyst 4948 Switch

7023685 Cisco Catalyst 4948E-F Switch

REFERENCE INFORMATION:

EIS Checklist for Exadata http://eis.us.oracle.com/checklists/checklists.html

References

<NOTE:1415044.1> - Upgrading firmware / Configuring SSH on Cisco Catalyst 4948 Ethernet Switch

Attachments

This solution has no attachment