VSM6, VSM7, VLE - How to restore the NIC port speed to the optimal operating speed

Asset ID:	1-71-2355034.1
Update Date:	2018-02-06
Keywords:

Solution Type Technical Instruction Sure

Solution 2355034.1 : VSM6, VSM7, VLE - How to restore the NIC port speed to the optimal operating speed

Applies to:

StorageTek Virtual Storage Manager System 7 (VSM7) - Version 7.0.0 to 7.1.2 [Release 7.0]
StorageTek Virtual Storage Manager System 6 (VSM6) - Version All Versions to All Versions [Release All Releases]
Sun Virtual Library Extension (VLE) - Version 1.0 to 1.5 [Release 1.0]
Oracle Solaris on SPARC (64-bit)
Oracle Solaris on x86-64 (64-bit)

Goal

Restore the speed for a Network Interface Card (NIC) port to the optimal value

Restore the NIC port to the proper speed

Correct NIC port speed incorrect or running slow

Correct NIC port not running at 10G

Correct NIC port not running at 1G

Solution

There can be times when a NIC port speed does not auto-negotiate to the optimal speed. The information below will assist in getting the port to the proper speed.

The following is an example of a VSM7 net4 port speed that is not correct. The information can be found in the Support File Bundle (SFB) display_health_check log or from the dladm_show_phys.txt log.

dladm_show_phys.txt
DATE: Sun Jan 28 10:09:02 CST 2018 (local time)

LINK     MEDIA   STATE SPEED DUPLEX DEVICE
net13 Infiniband   up    16000 unknown ibp1
net17 Infiniband   up    16000 unknown ibp3
net18 Infiniband   up    16000 unknown ibp2
net3 Ethernet      up    10000 full         ixgbe3
net6 Infiniband    down       0 unknown ibp4
net2 Ethernet      up    10000 full         ixgbe2
net7 Infiniband    down       0 unknown ibp5
net12 Ethernet    up         10 full         usbecm0
net5 Ethernet      up    10000 full         ixgbe5
net0 Ethernet      up    10000 full         ixgbe0
net1 Ethernet      up    10000 full         ixgbe1
net4 Ethernet      up       100 full         ixgbe4 <-----------incorrect, should be 10000 (10G)
net14 Infiniband   up    16000 unknown ibp0
net15 Ethernet     unknown 0 unknown clprivnet2
net16 Ethernet     up          0 unknown clprivnet0
net19 Ethernet     unknown 0 unknown clprivnet1
net20 Ethernet     unknown 0 unknown clprivnet3

Procedure to have the port re-negotiate the speed to 10G.

Current speed of Node 1 net4 (REP1). Per design, the port for the replication (REP) port on a VSM7 T7-2 is 10G.

vsmadm@vsmpriv1:~$ dladm show-phys net4
LINK MEDIA STATE SPEED DUPLEX DEVICE
net4 Ethernet up 100 full ixgbe4

Port link properties indicating the port speed is capable of 10G (10gfdx) - first column after the rw.

dladm show-linkprop net4 | grep en_ | grep fdx

vsmadm@vsmpriv1:~$ dladm show-linkprop net4 | grep en_ | grep fdx
net4 en_10gfdx_cap rw 1 1 1 1,0
net4 en_1000fdx_cap rw 1 1 1 1,0
net4 en_100fdx_cap rw 1 1 1 1,0
net4 en_10fdx_cap -- -- -- 0 1,0

Procedure to have the port re-negotiate the speed to 10G.

1. Run the command to enable 10G port speed

vsmadm@vsmpriv1:~$ sudo dladm set-linkprop -p en_10gfdx_cap=1 net4

2. Run the command to check the port speed.

vsmadm@vsmpriv1:~$ dladm show-phys net4

LINK MEDIA STATE SPEED DUPLEX DEVICE
net4 Ethernet up 100 full ixgbe4

3. If the commands above do not resolve the issue, then a reseat of the net4 cable at both ends is necessary.

4. Reference this document T7_2_SERVER_SW_CABLE_LAYOUT of the VSM7 server and ES1-24 switch.

The following is an example of a VSM6 net8 port speed that is not correct. The information can be found in the Support File Bundle (SFB) display_health_check log or from the dladm_show_phys.txt log.

dladm_show_phys.txt
DATE: Tue Jan 23 14:12:40 UTC 2018 (local time)

LINK MEDIA STATE SPEED DUPLEX DEVICE
net1 Ethernet up 1000 full igb1
net0 Ethernet unknown 0 unknown igb0
net3 Ethernet up 1000 full igb3
net2 Ethernet down 0 unknown igb2
net15 Infiniband up 16000 unknown ibp2
net16 Infiniband up 16000 unknown ibp3
net11 Ethernet up 100 full igb7
net6 Ethernet up 1000 full igb10
net10 Ethernet up 1000 full igb6
net5 Ethernet up 1000 full igb9
net9 Ethernet up 1000 full igb5
net8 Ethernet up 100 full igb4 <----------------should be 1000 (1G)
net4 Ethernet up 1000 full igb8
net7 Ethernet up 1000 full igb11
net21 Ethernet unknown 0 unknown clprivnet3
net22 Ethernet unknown 0 unknown clprivnet1
net23 Ethernet unknown 0 unknown clprivnet0
net24 Ethernet unknown 0 unknown clprivnet2
net12 Ethernet up 10 full usbecm2
net13 Infiniband up 16000 unknown ibp0
net14 Infiniband up 16000 unknown ibp1

Commands to check prior to any maintenance for net4

Current speed of Node 1 net8 (REP3). Per design, the port for the REP port on a VSM6 T4-2 is 1G.

vsmadm@vsmpriv1:~$ dladm show-phys net8
LINK MEDIA STATE SPEED DUPLEX DEVICE
net8 Ethernet up 100 full igb4

Port link properties indicating the port speed is capable of 1G (1000fdx) - first column after the rw.

dladm show-linkprop net8 | grep en_ | grep fdx

vsmadm@vsmpriv1:~$ dladm show-linkprop net8 | grep en_ | grep fdx
net8 en_1000fdx_cap rw 1 1 1 1,0
net8 en_100fdx_cap rw 1 1 1 1,0
net8 en_10fdx_cap -- -- -- 0 1,0

Procedure to have the port re-negotiate the speed to 1G.

1. Run the command to enable 1G port speed

vsmadm@vsmpriv1:~$ sudo dladm set-linkprop -p en_1000fdx_cap=1 net8

2. Run the command to check the port speed.

vsmadm@vsmpriv1:~$ dladm show-phys net8

LINK MEDIA STATE SPEED DUPLEX DEVICE
net4 Ethernet up 1000 full igb4

3. If the commands above do not resolve the issue, then a reseat of the net8 cable at the server is necessary.

4. Reference this document T4-2 SERVER_PORT_LAYOUT.

This same procedure can be used for other NIC ports on a VSM6, VSM7 or VLE providing the switch connecting the port is set to the appropriate speed per engineering design.

Attachments

This solution has no attachment