Troubleshooting Fibre Channel (FC) HBA Card That Is Not Seen By The Solaris OS

Asset ID:	1-71-1630881.1
Update Date:	2018-03-15
Keywords:

Solution Type Technical Instruction Sure

Solution 1630881.1 : Troubleshooting Fibre Channel (FC) HBA Card That Is Not Seen By The Solaris OS

Applies to:

Qlogic FC HBA - Version All Versions to All Versions [Release All Releases]
Sun Storage FC HBA - Version All Versions to All Versions [Release All Releases]
Sun SPARC Enterprise M5000 Server - Version All Versions to All Versions [Release All Releases]
Emulex FC HBA - Version All Versions to All Versions [Release All Releases]
Sun Storage FCoE CNA - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Goal

This document discusses FC HBA PCI cards, not the embedded FC interface on server's system board.

Note: Ethernet/IP Network Interface Cards (NIC) with Fibre Channel Interfaces can be mistaken for FC HBA cards.

Regardless if a fc hba port is seeing any storage devices the fc hba card itself is normally recognized by the Solaris Operating System and listed in several command outputs including:

- fcinfo hba-port (Solaris 10 and above)
- cfgadm -al
- prtdiag -v
- luxadm -e port
- prtpicl -v

Note: NON-Oracle fc hba cards using Oracle FC HBA Drivers will be listed in above commands as well. NON-Oracle fc hba cards using NON-Oracle FC HBA Drivers will only be listed in following commands:

- fcinfo hba-port (Solaris 10 and above)
- prtdiag -v
- prtpicl -v

If issue is determined to be defective card your NON-Oracle FC HBA card support vendor will need to be contact to troubleshoot and/or replace the card.

How to Identify Oracle[TM] Branded Fibre Channel (FC) HBA and CNA Cards and Their Slot Locations (Doc ID 1282491.1)

Solution

There are three situations when troubleshooting fc hba cards not seen by the Solaris Operating System:

1 - FC HBA is "known for sure" to have been working and seen by OS up until issue began.

2 - FC HBA is being installed and trying to get it working for the first time.

3 - Do not know if fc hba card was ever setup/install/seen and working or if the card is still even in the server.

See following related documents that may be relevent:

SPARC T4 Servers - PCIe Host Bus Adapter (HBA) Disappears During Reboot (Doc ID 1571110.1)

fcinfo Reports "No Adapters Found" and cfgadm Does Not Show FC Adapters (HBAs) (Doc ID 1426095.1)

FC HBA cards can not be installed on Solaris 10 non-global zone (Doc ID 1537379.1)

Changes to /etc/driver_aliases file cause Oracle Fibre Channel (FC) HBA cards not to be seen in Solaris cfgadm and fcinfo commands (Doc ID 1580680.1)

[SPARC T4/T5] FMA I/O retirement : PCI devices can be seen from OBP but disappears when System Boots up into Solaris (Doc ID 1614738.1)

FC HBA Emlxs ERROR: 420: Adapter Hardware Error. (Host Error Attention: Status=0x40000000 (Doc ID 1602837.1)

Sun Storage 8Gb FC PCIe HBA Card Is Not Detected (Doc ID 1452775.1)

Create a SR, Collect and Upload a SnapShot and Explorer output to SR and have Server support engineer check following 2 documents to see if they are a factor in FC HBA (PCI) Card not being seen by Solaris:

<Document 1555123.1> Collect ILOM snapshot(s) by running STB7.3 and later domain Explorer

<Document 2077387.1> Simple instructions to collect ILOM snapshot

<Document 1020204.1> Collecting snapshot on ILOM 3.x and later platforms

<Document 1643464.1> [SPARC T3/T4 and T5] OBP reports "One or more resources have been retired, please run 'show faulty' on the SP" on console

<Document 2079496.1> FC HBA PCI Card Not Detected by Solaris After T5-4 Firmware Upgrade

The following are steps that can be taken if fc hba card is not seen by the Solaris Operating System:

=================================
Situation #1 - FC HBA card is "known for sure" to have been working and seen by OS up until issue began.
=================================

1 - Check if the fc hba card has been retired by running following commands:

ls -l /etc/devices/retire_store

strings /etc/devices/retire_store | grep pci

Note: /etc/devices/retire_store is now collected in Explorer 8.02 and later versions.

See Oracle Explorer Data Collector: Modules, Module Groups, Module Aliases Summary(Doc ID 1536532.1)

2.1 - Collect hba info per following document

<Document 2345039.1> How to check Fibre Channel (FC) HBA port Light Tx and Rx Power Levels

3 - Locate fc hba card in server slot and verify one or more of the LEDs are on indicating the card has power.

4 - Check LED patterns for fault conditions. See fc hba card documentation and/or following doc:

How to interpret Oracle FC HBA port LED patterns (Doc ID 1399644.1)

5 - If possible, shutdown server then:

Determine if fc hba card can be seen from OBP (SPARC Servers) or BIOS (x86/x64 Servers) level:

SPARC Servers
==================

Bring server down/up to ok prompt

Verify autoboot is set to false, and reset the system.

ok printenv auto-boot?

auto-boot? = true

ok setenv auto-boot? False

auto-boot? = false

ok reset-all

ok probe-scsi-all

Capture output for reference later if needed.

x86/x64 Servers
==================

- check if BIOS can see the fc hba card.

See BIOS documentation for instructions.

Capture screen shot output for reference later if needed.

If fc hba card is "Customer Replaceable Unit" (CRU) see following link for documentation and proper fc hba card handling procedures.

Getting Fibre Channel (FC) HBA Information From "Sun System Handbook" via My Oracle Support (MOS) (Doc ID 1630834.1)

then try

- re-seating fc hba card in it original slot.

and/or

- inserting fc hba card into another compatible slot.

then power/boot up server and check if Solaris Operating System can see card or not.

If no change collect new explorer (see "Collecting Explorer Data" section below) output and open a Oracle Service Request (SR) via My Oracle Support (MOS) portal. A support engineer will review data and troubleshoot issue.

See doc
Fibre Channel (FC) Server-Based Connectivity Issues - Basic information and data needed by Oracle support (Doc ID 1449557.1)

=================================
Situation #2 - FC HBA card is being installed and trying to get it working for the first time.
=================================

1 - Verify fc hba card is supported on server platform.

2 - Follow documented installation procedure.

3 - Locate fc hba card in server slot and verify one or more of the LEDs are on indicating the card has power.

4 - Verify fc hba card can be seen from OBP (SPARC Servers) or BIOS (x86/x64 Servers):

SPARC Servers
==================

Bring server down to ok prompt

Verify autoboot is set to false, and reset the system.

ok printenv auto-boot?

auto-boot? = true

ok setenv auto-boot? False

auto-boot? = false

ok reset-all

ok probe-scsi-all

Capture output for reference later if needed.

x86/x64 Servers
==================

- check if BIOS can see the fc hba card.

See BIOS documentation for instructions.

Capture screen shot output for reference later if needed.

If fc hba card is "Customer Replaceable Unit" (CRU) see following link for documentation and proper fc hba card handling procedures.

Getting Fibre Channel (FC) HBA Information From "Sun System Handbook" via My Oracle Support (MOS) (Doc ID 1630834.1)

then try

- re-seating fc hba card in it original slot.

and/or

- inserting fc hba card into another compatible slot.

then power up server and check if OBP (SPARC Servers) or BIOS (x86/x64 Servers) can see fc hba.

If fc hba card is seen then boot up server and check if Solaris Operating System can see card or not.

If fc hba card is not seen by OBP (SPARC Servers) or BIOS (x86/x64 Servers) open a Oracle Service Request (SR) via My Oracle Support (MOS) portal and provide probe-scsi-all or bios screenshots data for analysis. A support engineer will review data and troubleshoot issue.

5 - Solaris Operating System still does not see the fc hba card.

Collect new explorer (see "Collecting Explorer Data" section below) output and open a Oracle Service Request (SR) via My Oracle Support (MOS) portal. A support engineer will review data and troubleshoot issue.

See doc
Fibre Channel (FC) Server-Based Connectivity Issues - Basic information and data needed by Oracle support (Doc ID 1449557.1)

=================================
Situation #3 - Do not know if fc hba card was ever setup and working.
=================================

1 - Verify fc hba card is actually in the server.

2 - Locate fc hba card in server slot and verify one or more of the LEDs are on indicating the card has power.

3 - Verify fc hba card can be seen from OBP (SPARC Servers) or BIOS (x86/x64 Servers):

SPARC Servers
==================

Bring server down to ok prompt

Verify autoboot is set to false, and reset the system.

ok printenv auto-boot?

auto-boot? = true

ok setenv auto-boot? False

auto-boot? = false

ok reset-all

ok probe-scsi-all

ls -l /etc/devices/retire_store

strings /etc/devices/retire_store | grep pci

If path for the fc hba card is listed then see doc:

[SPARC T4/T5] FMA I/O retirement : PCI devices can be seen from OBP but disappears when System Boots up into Solaris (Doc ID 1614738.1)

4 - Solaris Operating System still does not see the fc hba card.

Collect new explorer (see "Collecting Explorer Data" section below) output and open a Oracle Service Request (SR) via My Oracle Support (MOS) portal. A support engineer will review data and troubleshoot issue.

See doc
Fibre Channel (FC) Server-Based Connectivity Issues - Basic information and data needed by Oracle support (Doc ID 1449557.1)

Collect hba info per following document
<Document 2345039.1> How to check Fibre Channel (FC) HBA port Light Tx and Rx Power Levels

=================================
Collecting Explorer Data
=================================

Note: Upload previous outputs first before collecting a new explorer.

Current version of explorer available from Oracle as of 10 Sept 2013 is 8.0

Check current explorer version:

# /opt/SUNWexplo/bin/explorer -V

Upgrade to latest explorer version if possible.

Oracle Explorer Data Collector - Product Information Center (Doc ID 1312847.1)

explorer -g has to be run to configure explorer if newly installed before it can be run.

Run "explorer -k -w all" in case their default file bypasses some modules and so we do not overwrite any previous explorer files in directory.

Having previous Explorer data outputs maybe useful in troubleshooting. Do following to see if you have any previous explorer outputs:

# cd /opt/SUNWexplo/output
# ls -l

If you do have previous explorer file upload that to the SR first then collect a new explorer.

For file size less than 2GB upload directly to the SR.

Per
Oracle Support File Uploads (Doc ID 1547088.2)

To upload a file to an existing SR, click the link for the SR in one of the SR regions.

or

To upload a file while creating an SR, complete Step 2 of the Create Service Request flow.

then

Click Add Attachment. You can upload a recommended file or another file.

In the Attach File window, click Browse, select the file that you want to attach, and then click Attach File.

For more information on this see MY ORACLE SUPPORT online help:
http://docs.oracle.com/cd/E25290_01/doc.60/e25224/srhome.htm#autoId20

Note: April 2014 EOSL "supportfiles.sun.com"

- do not upload files to "supportfiles.sun.com"
- preferred methods for file uploads are My Oracle Support (files less than 2GB), transport.oracle.com (files greater than 2GB), and Secure File Transport (SFT) for proactive files.
- should no longer use supportfiles.sun.com, supportuploads.sun.com or ftp.sun.com when uploading files to Oracle support: they will be decommissioned in April 2014. In addition, while sftp.oracle.com remains an option for uploading files to Oracle, it will no longer be connected to support's back end systems and should not be used for SR or proactive uploads.

Attachments

This solution has no attachment