Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-79-1914897.1
Update Date:2015-11-05
Keywords:

Solution Type  Predictive Self-Healing Sure

Solution  1914897.1 :   How To Test Infiniband Bandwidth Speeds In Exalogic Environment  


Related Items
  • Oracle Exalogic Elastic Cloud Software
  •  
  • Sun Server X4-2L
  •  
Related Categories
  • PLA-Support>Eng Systems>Exalogic/OVCA>Oracle Exalogic>MW: Exalogic Core
  •  




In this Document
Purpose
Details
References


Created from <SR 3-8834685591>

Applies to:

Oracle Exalogic Elastic Cloud Software - Version 1.0.0.0.0 and later
Sun Server X4-2L
Linux x86-64
Oracle Solaris on x86-64 (64-bit)
Oracle Virtual Server (x86-64)

Purpose

This document provides information about testing Infiniband bandwidth speeds on Exalogic

Details

Infiniband network speeds in Exalogic can be tested using following utilities

  • iperf
  • rdma

iperf:

iperf can be downloaded from Document ID : 1507397.1 - How to Use Iperf to Test Network Performance

Following are steps to run iperf utility on Exalogic nodes/vServers to test the bandwidth speeds.

  1. If one of the nodes to which you want to test the bandwidth speeds from other client nodes run following command
    ./iperf64 -s 
  2. On the clients nodes where you want to test the bandwidth speeds connecting to node on step 1 run following command.
    ./iperf64 -c 

    Following is the same snippet of output
    ./iperf64 -c 192.168.10.21
    ------------------------------------------------------------
    Client connecting to 192.168.10.21, TCP port 5001
    TCP window size:   193 KByte (default)
    ------------------------------------------------------------
    [  3] local 192.168.10.114 port 25134 connected with 192.168.10.21 port 5001
    [ ID] Interval       Transfer     Bandwidth
    [  3]  0.0-10.0 sec  10.5 GBytes  9.00 Gbits/sec
     

rdma:

rdma utility is by default enabled on Exalogic nodes.

Following are steps to run rdma utility on Exalogic nodes/vServers to test the bandwidth speeds.

  1. If one of the nodes to which you want to test the bandwidth speeds from other client nodes runs run following command
    rdma_bw 
  2. On the clients nodes where you want to test the bandwidth speeds connecting to node on step 1 run following command.
    rdma_bw <Infiniband IP Address of Node 1> 

    Following is the same output
    rdma_bw 192.168.23.2
    3503: | port=18515 | ib_port=1 | size=65536 | tx_depth=100 | sl=0 | iters=1000 | duplex=0 | cma=0 |
    3503: Local address:  LID 0x05, QPN 0x34055e, PSN 0x7c7fa0 RKey 0x98017f8a VAddr 0x007f58215f7000
    3503: Remote address: LID 0x07, QPN 0x4c055a, PSN 0x9a7656, RKey 0x20015309 VAddr 0x007fce95b4c000


    3503: Bandwidth peak (#0 to #25): 3173.07 MB/sec
    3503: Bandwidth average: 3162.26 MB/sec
    3503: Service Demand peak (#0 to #25): 890 cycles/KB
    3503: Service Demand Avg  : 893 cycles/KB
     

 

References

<NOTE:1507397.1> - How to Use Iperf to Test Network Performance

Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback