Exalogic ZS3-ES Heads: Critical Fault Message "A hardware fault within the device or its interface was detected in the USB device. The driver has failed to initialize the device and the device is in an invalid state"

Asset ID:	1-72-2019044.1
Update Date:	2017-11-10
Keywords:

Solution Type Problem Resolution Sure

Solution 2019044.1 : Exalogic ZS3-ES Heads: Critical Fault Message "A hardware fault within the device or its interface was detected in the USB device. The driver has failed to initialize the device and the device is in an invalid state"

Applies to:

Exalogic Elastic Cloud X5-2 Hardware - Version X5 to X5 [Release X5]
Exalogic Elastic Cloud X4-2 Eighth Rack - Version X4 to X4 [Release X4]
Exalogic Elastic Cloud X4-2 Hardware - Version X4 to X4 [Release X4]
Oracle Exalogic Elastic Cloud Software - Version 2.0.6.0.0 to 2.0.6.2.170418
Linux x86-64
Oracle Solaris on x86-64 (64-bit)
Oracle Virtual Server (x86-64)

Symptoms

In Exalogic racks with ZS3-ES Storage heads Critical Fault message "A hardware fault within the device or its interface was detected in the USB device. The driver has failed to initialize the device and the device is in an invalid state" is thrown on one of the ZFS heads.

Note:

The above critical fault message appearing, even a USB drive never used. ZS3-ES heads do not have a USB drive.

Below is screenshot of the message shown in ZFS BUI.

ZS3-ES

Cause

This issue happens due to following known Bug:

BUG 25223778 / 20957047/15805238 : Unrecoverable USB Hardware Error reported on internal USB

Solution

This fault message can be safely ignored as it does not cause any performance or functional impact to Exalogic ZFS appliance.

The Bug 25223778 fix is included in the Exalogic April 2017 PSU release (i.e. 2.0.6.2.170418). It is highly recommended to upgrade to the latest PSU release to take advantage of this fix.

For the latest PSU releases please review Document ID : 1314535.1 - Exalogic Patch Set Updates (PSU) Master Note

In case if the upgrade is not possible immediately and If there is an amber light due to this fault message, login to the ZFS BUI and under the "Maintenance:Problems". If the fault is listed there, have it mark as repaired, then check the LED status.

After "mark repaired", if the LED is still amber and FAULT still unchanged, then fault has to be cleared manually through a ZFS shared shell. Please contact Oracle Customer Support.

Note to Support Engineers, when customer opens a Service Request, please engage the ZFS Support to manually clear the fault.

Alternatively the issue can fixed by applying the workflow , but get validated by ZFS Support team, before running on customer enviroment.

ZFS Support through a shared shell perform the listed procedure from the Document ID : 2018621.1 - Oracle ZFS Storage Appliance: Unrecoverable USB Hardware Error reported on internal USB

Note

The error can only be cleared when the head is in owning state

For example to clear the sn02, need to make sn02 the owner

To make sn01 owner, reboot sn02
To make sn02 owner, reboot sn01

References

<NOTE:1448069.1> - How to run an ILOM Snapshot on a Sun/Oracle X86 System
<NOTE:2018621.1> - How To Resolve Unrecoverable USB Hardware Error Reported On Internal USB For ZFS Storage Appliance
<NOTE:2042348.1> - Oracle ZFS Storage Appliance: How to recover from a USB fault on a ZS3-X, if 'Mark As Repaired' does not work
<BUG:20957047> - UNRECOVERABLE USB HARDWARE ERROR REPORTED ON INTERNAL USB
<BUG:15805238> - SUNBT7185764 INSTALL CRASH WITH BAD MARSHAL DATA INTERMITTENTLY ON X4170M3/X4270

Attachments

This solution has no attachment