Multipath Failure On ODA

Asset ID:	1-72-1478033.1
Update Date:	2018-01-25
Keywords:

Solution Type Problem Resolution Sure

Solution 1478033.1 : Multipath Failure On ODA

Applies to:

Oracle Database Appliance - Version All Versions and later
Information in this document applies to any platform.

Symptoms

Hard Disk goes into offline status for few minutes comes back to online state. Upon reboot, one of the nodes of the ODA could not start, while the second node starts and contineous to work. Further, the disk status is displayed as both ok and failure in the system.

Cause

Messages file shows

Jul 5 11:46:36 acehqoc0011 kernel: sd 7:0:14:0: [sdan] Unhandled sense code

Jul 5 11:46:36 acehqoc0011 kernel: sd 7:0:14:0: [sdan] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE

Jul 5 11:46:36 acehqoc0011 kernel: sd 7:0:14:0: [sdan] Sense Key : Medium Error [current]

Jul 5 11:46:36 acehqoc0011 kernel: Info fld=0x3c07f5f0

Jul 5 11:46:36 acehqoc0011 kernel: sd 7:0:14:0: [sdan] Add. Sense: Unrecovered read error

Jul 5 11:46:36 acehqoc0011 kernel: sd 7:0:14:0: [sdan] CDB: Read(10): 28 00 3c 07 f4 01 00 04 00 00 Jul 5 11:46:36 acehqoc0011 kernel: end_request: I/O error, dev sdan, sector 1007154672

Jul 5 11:46:41 acehqoc0011 multipathd: HDD_E0_S04_1137778563: sdan - directio checker reports path is up Jul 5 11:46:41 acehqoc0011 multipathd: 66:112: reinstated

Disk status in oakcli shows good

oakcli show-disk shows

pd_04 /dev/sdan HDD ONLINE Good

oakcli lsscsi shows

[6:0:1:0] disk SEAGATE ST360057SSUN600G 0A25 /dev/sdd [7:0:14:0] disk SEAGATE ST360057SSUN600G 0A25 /dev/sdan

oakcli show-disk_detail shows

Disk: pd_04 ActionTimeout : 600

ActivePath : /dev/sdan

AsmDiskList : |data_04||reco_04|

AutoDiscovery : 1

AutoDiscoveryHi : |data:86:HDD||reco:14:HDD||redo:100

CheckInterval : 100 ColNum : 0

DiskId : 35000c50043d11f83

DiskType : HDD

Enabled : 0

ExpNum : 0

IState : 0

Initialized : 0

MonitorFlag : 0

MultiPathList : |/dev/sdan||/dev/sdd|

Name : pd_04

NewPartAddr : 0

PrevState : 5

PrevUsrDevName :

SectorSize : 512

SerialNum : 001144E2GALD

Size : 600127266304

SlotNum : 4

State : Online

StateChangeTs : 1341929068

StateDetails : Good

TotalSectors : 1172123567

TypeName : 0

UsrDevName : HDD_E0_S04_1137778563

gid : 0

mode : 660

uid : 0

Solution

This is caused due to

Bug 14049272: LNX64-112-CMT: MASSIVE MULTIPATH FAILURE ON ODA

This BUG has been fixed in ODA 2.3.0.0.0.

Upgrade to ODA 2.3.0.0.0.

References

<NOTE:166650.1> - Working Effectively With Oracle Support - Best Practices
<NOTE:1390058.1> - Oracle Database Appliance Diagnostic Information required for Disk Failures
<NOTE:888888.1> - Oracle Database Appliance - 12.2.1.1 and 2.X Supported ODA Versions & Known Issues
<BUG:14049272> - LNX64-112-CMT: MASSIVE MULTIPATH FAILURE ON ODA

Attachments

This solution has no attachment