Oracle Virtual Networking (Formerly Xsigo) LUNs Presented to Solaris 11.2 SRU11 Host From an EMC XtremeIO FC Array and Oracle Fabric Interconnect are not Fully Visible at the OS

Asset ID:	1-72-2032293.1
Update Date:	2018-02-07
Keywords:

Solution Type Problem Resolution Sure

Solution 2032293.1 : Oracle Virtual Networking (Formerly Xsigo) LUNs Presented to Solaris 11.2 SRU11 Host From an EMC XtremeIO FC Array and Oracle Fabric Interconnect are not Fully Visible at the OS

Applies to:

Oracle Fabric Interconnect F1-15 - Version All Versions to All Versions [Release All Releases]
Oracle Fabric Interconnect F1-4 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

LUNs originating on an EMC XtremIO FC SAN are being presented to Solaris 11.2 SRU11 hosts via two Oracle Fabric Interconnects are visible at the 'fcinfo lu' command level.

The LUNs are visible on the Oracle Fabric Interconnects CLI (Command Line Interface) by issuing this command as user 'admin':

show vhba <vhbaname.server-profilename> targets

root@artotxlpp01cd04:~# fcinfo lu
OS Device Name: /pci@3c0/pci@1/pci@0/pci@7/pciex15b3,1003@0/hermon@1/ibport@2,ffff,xstn/san_a_0@5001397000732100/iport@v0/disk@w21000024ff3d8f99,4f
OS Device Name: /pci@3c0/pci@1/pci@0/pci@7/pciex15b3,1003@0/hermon@1/ibport@2,ffff,xstn/san_a_0@5001397000732100/iport@v0/disk@w21000024ff3d8f99,15

OS Device Name: /pci@300/pci@1/pci@0/pci@4/pciex15b3,1003@0/hermon@0/ibport@2,ffff,xstn/san_b_0@5001397000730115/iport@v0/disk@w21000024ff3d8ddd,2
OS Device Name: /pci@300/pci@1/pci@0/pci@4/pciex15b3,1003@0/hermon@0/ibport@2,ffff,xstn/san_b_0@5001397000730115/iport@v0/disk@w21000024ff3d8ddd,0

There are a total of 640 lines of output (160 luns x 4 paths to each)

However, the issue is that the 'devfsadm -Cv' command does not build appropriate device paths for the LUNs so the format command cannot see them.

The four line-items in format(1M) output presented below, are the internal disks on the server, i.e. other LUNs from EMC XtremIO FC SAN are missing:

root@artotxlpp01cd04:~# devfsadm -Cv
root@artotxlpp01cd04:~# echo ""|format
Searching for disks...done

AVAILABLE DISK SELECTIONS:
0. c0t5000CCA06E129910d0
/scsi_vhci/disk@g5000cca06e129910
/dev/chassis/SYS/SASBP/HDD0/disk
1. c0t5000CCA06E1344F8d0 solaris
/scsi_vhci/disk@g5000cca06e1344f8
/dev/chassis/SYS/SASBP/HDD1/disk
2. c0t5000CCA06E130658d0
/scsi_vhci/disk@g5000cca06e130658
/dev/chassis/SYS/SASBP/HDD4/disk
3. c0t5000CCA06E1315E0d0 solaris
/scsi_vhci/disk@g5000cca06e1315e0
/dev/chassis/SYS/SASBP/HDD5/disk
Specify disk (enter its number): Specify disk (enter its number):
root@artotxlpp01cd04:~#

Further checks done / Symptoms:

- From the requested output Support was able to determine that the host driver is loaded up fine and there was no evidence of IBTI version mismatch problem.

- "mpathadm show LU" does not show LUNs that are attached.

Changes

Adding LUNs to Solaris 11.2 SRU11 from an EMC XtremIO FC Storage array.

Cause

Solaris now defines different multipathing methods, depending on the vendor and also generic options are provided.

The correct multipathing method needs to be defined - please see the Solution section below and the link to the related Doc.

Solution

Please check the following document for the detailed solution:

Solaris I/O Multipathing (MPxIO) Does Not Automatically Function With Some Third Party Storage (Doc ID 1580076.1)

Having referred to that document, for the particular customer involved, the solution involved using the "f_sym_emc" option in Solaris 11 /etc/driver/drv/scsi_vhci.conf file:

scsi-vhci-failover-override = "XtremIO XtremApp", "f_sym_emc";

Please check the aforementioned Doc ID 1580076.1 for the correct option for your particular Storage.

Internal note: The links/references at the bottom of this Document to the IBTI Bugs, especially Bug 21066589, are provided for internal reference only. As mentioned in Symptoms section, this had already been checked and did not apply for this customer.

References

<BUG:21066589> - IBTI VERSION MISMATCH ON SOLARIS 11.2 SRU9
<BUG:21417958> - SOLARIS 11.2 SRU11 :: IBT_ATTACH FAILURE: IBTI VERSION MISMATCH
<NOTE:1517366.1> - How to Create/Upload Diagnostic Log File Bundle for an Oracle Fabric Interconnect
<NOTE:1339783.1> - Automated Diagnosis Requirements and Expectations for Disk Storage
<NOTE:1580076.1> - Solaris I/O Multipathing (MPxIO) Does Not Automatically Function With Some Third Party Storage
<NOTE:1153444.1> - Oracle Services Tools Bundle (STB) - RDA/Explorer, SNEEP, ACT

Attachments

This solution has no attachment