How to display and/or change Infiniband Node name

Asset ID:	1-71-1480121.1
Update Date:	2018-01-03
Keywords:

Solution Type Technical Instruction Sure

Solution 1480121.1 : How to display and/or change Infiniband Node name

Applies to:

Sun Datacenter InfiniBand Switch 36 - Version Not Applicable to Not Applicable [Release N/A]
Exadata X3-2 Hardware - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.
On any node of an infiniband network, the following command displays the name of all the nodes:
#ibnodes

Here is an example:
# ibnodes
Ca : 0x0021280001a0a85c ports 2 "x4170-sin06-c"
Ca : 0x0021280001a0a79c ports 2 "x4170-sin06-d HCA-1"
Ca : 0x00212856cbe2c000 ports 2 "SUN IB QDR GW switch localhost 10.186.85.157 Bridge 0"
Ca : 0x00212856cbe2c040 ports 2 "SUN IB QDR GW switch localhost 10.186.85.157 Bridge 1"
Switch : 0x00212856cbe2c0a0 ports 36 "SUN IB QDR GW switch localhost 10.186.85.157" enhanced port 0 lid 1 lmc 0

The field within "" is the name of that node. This document shows how these names can be changed.

Goal

How to know and/or change the infiniband node name of a node ?

Solution

A. ibswitches

To display the name of an IB switch, login to that switch, and run the following command:

/usr/sbin/set_nodedesc.sh -v

Here is an example:

# /usr/sbin/set_nodedesc.sh -v
is4_0: SUN IB QDR GW switch localhost 10.186.85.157

The recommended method of changing the name of the Infiniband switch is as follows;

->cd /SP
->set hostname="new name"

Exanple:

                -> cd /SP
                -> set hostname=ib_gw            <<<<<<< ib_gw is the new name to be set
                -> show /SP hostname
                -> set /SP/services/servicetag state=disabled
                -> set /SP/services/servicetag state=enabled
-> exit

# /usr/sbin/set_nodedesc.sh -v
is4_0: SUN IB QDR GW switch ib_gw 10.187.56.241

B. Nodes running Linux

In a node running Linux, the name of the node is in the file /sys/class/infiniband/mlx4_0/node-desc

Node name can also be changed by modifying this as follows:

echo "new_node_name" > /sys/class/infiniband/mlx4_0/node_desc

C. Nodes running Solaris

If the node is running Solaris 11, and if it has only one IB HCA, the following command can be used to change the node name:

# /usr/sbin/set_nodedesc.sh -N <new node name>

Here is an example:

# /usr/sbin/set_nodedesc.sh -N "My Sol 11 Machine"

After that, the name of this node will be displayed as:

# /usr/sbin/set_nodedesc.sh -v
mlx4_0: My Sol 11 Machine HCA-1

To understand the syntax and all options of these commands, run the command with -h option as follows:

# /usr/sbin/set_nodedesc.sh -h

      solaris_set_nodedesc: illegal option -- h
     Usage: solaris_set_nodedesc
      solaris_set_nodedesc [-N(ode_Descriptor) CmnString]
      solaris_set_nodedesc [-H(CA_Description) HCAString -G(UID) HCA_GUID]
      solaris_set_nodedesc [-H(CA_Description) HCAString -G(UID) HCA_GUID -N(ode_Descriptor) CmnString]
      solaris_set_nodedesc [-v]

Another example with a name string including its its ip address and HCA name (HCA-1): This command can be used when there are multiple HCA in the machine.

#/usr/sbin/set_nodedesc.sh -H "S 192.168.1.10 HCA-1" -G 0x0010e0000128be3c -N "My Sol 11 Machine"

where 0x0010e0000128be3c is the GUID of the HCA.

After this, the name will be displayed as:

# /usr/sbin/set_nodedesc.sh -v
mlx4_0: My Sol 11 Machine S 192.168.1.10 HCA-1

And,

   #ibhosts
       <snip>
      Ca : 0x0010e0000128be3c ports 2 "My Sol 11 Machine S 192.168.1.10 HCA-1"

Attachments

This solution has no attachment