SL8500 - All Drives in 2 Rows Fail to Load, Result Code 6019

Asset ID:	1-72-2211257.1
Update Date:	2017-12-28
Keywords:

Solution Type Problem Resolution Sure

Solution 2211257.1 : SL8500 - All Drives in 2 Rows Fail to Load, Result Code 6019

Applies to:

Sun StorageTek SL8500 Modular Library System - Version All Versions and later
Information in this document applies to any platform.

Evidence of crossed cables was confirmed locally by just loading a tape in one rail1 drive and notice the unexpected state change on the same drive column next above or below the mounted drive.

Symptoms

Drives leaving tapes at rail-1 with drive row 2 and 3.

All Drives in 2 Rows Fail to Load, Result Code 6019

A put of cartridge M0451AL6, to drive 1,1,1,1,2 (58) was attempted here, but failed:
2016-06-30 16:27:52 le11 296101 1,1,0,2,0 Robot 1,2 move DEVICE_OUTPUT putCartridgeRequest address: 1,1,1,1,2 (Drive 58)
Data=<request sequence="20611"><command>putCartridge</command><requestId>internalActivity</requestId><parms><address>1,1,1,1,2</address><cartType>Ultrium6</cartType><safeColumn>54</safeColumn><driveType>IbmUltrium6</driveType</parms></request>

At the same time, a put was being attempted to drive 1,1,1,1,3, but that cartridge was being moved from rail 2 to the drive, but hadn't yet reached the elevator, when this stateChangeNotice is reported:

2016-06-30 16:27:59 le11 0 1,1,1,1,3 Drive 54 internal DEVICE_INPUT state_change_notice_request:<final:true parms:<address:"1,1,1,1,3" device_type:"drive" drive_state:"cartridgePresent" host_activity:false needs_cleaning:false over_temp:false validation_in_prog:false > sequence:160 >Data=<request sequence="160" final="true"><command>stateChangeNotice</command><parms><deviceType>drive</deviceType><address>1,1,1,1,3</address><driveState>cartridgePresent</driveState><needsCleaning>false</needsCleaning><hostActivity>false</hostActivity><overTemp>false</overTemp<validationInProg>false</validationInProg></parms></request>

Note the timing on the stateChangeNotice is after the putCartridgeRequest is sent to the robot.

The robot fails the put here:
2016-06-30 16:28:06 le11 296101 1,1,0,2,0 Robot 1,2 move DEVICE_WARN_INPUT putCartridgeResponse address: 1,1,1,1,2 (Drive 58) resultCode: 5614 resultSeverity: warn resultText: "cmo_user_put: hand empty, forcing successful flag=true, cmo_status=5, code=5614, opState=0; cmo_user_put: Retry Performed 5611; cmo_user_put Failed Put: cmo_status=0, reach safe=1, hand cart state=0, prox=0, loc check=1; End of Text"

And, drive 1,1,1,1,2, fails the putComplete:
2016-06-30 16:28:06 le11 296101 1,1,1,1,2 Drive 58 move DEVICE_ERROR_INPUT putCompleteResponse operationalState: 602 resultCode: 6019 resultSeverity: error resultText: "drive 1,1,1,1,2: putComplete FAILED: (putFailed = false, state = empty)"

While this is NOT direct proof that there is something swapped between rows 2 and 3 of rail 1, it is definitely suspicious.

Cartridge M0451AL6, eventually ends up in location 1,1,4,1,6 because it's seen there 2016-07-01 00:59:02, when an audit was done. This is after the door open and the signs that drive 1,1,1,1,3 was manually unloaded. I don't see a move from the CAP, though it was opened and cartridges were moved into the library afterwards, so it's very likely the cartridge was placed in 1,1,4,1,6 by hand.

Cause

This is an installation mistake by customer.

Solution

Resolved the failed mounts to rows2/3 on rail1 by swapping TTI cables to the correct HBOs.

P235-13 Gray, ribbon HBY Card Bottom HBO card

P235-14 Gray, ribbon HBY Card 2nd HBO card (these two where swapped on the HBO end)

P235-15 Gray, ribbon HBY Card 3rd HBO card (these two where swapped on the HBO end)

P235-16 Gray, ribbon HBY Card Top HBO card

Attachments

This solution has no attachment