T10000D - Write Errors, FSCs: 3961, 377A, 37A4

Asset ID:	1-72-1617869.1
Update Date:	2017-05-18
Keywords:

Solution Type Problem Resolution Sure

Solution 1617869.1 : T10000D - Write Errors, FSCs: 3961, 377A, 37A4

Applies to:

StorageTek T10000D Tape Drive - Version All Versions and later
Information in this document applies to any platform.

Bug 18087902 - New production T10KD drives started to report FSCs: 3961, 377A, 37A4

6 new production drives which were taken to production 1.1.2014 were performing excellent, until suddenly issues started to happen one drive after another.
14.1.2014 one drive started to have issues with writing.
Next day another drive joined the club.. then a third drive.
All drives including replacement drive ended up having the same issue.

Symptoms

Write Errors, FSCs: 3961, 377A, 3A74

FSC36911, FSC377A, FSC37A4

2014-01-16T00:34:08.940, 1.1.-1.1.1, root, hli0, move, 7970201, w
arn, 3992, "Warning from device", Data=>rewindUnload<resultSeve
rity>warn6434<!|CDATA|driv
e 1,1,-1,1,1: rewindUnload Successful with mediaError: Cartridge Label: , FSC:
3961||>000ult>

2014-01-16T05:31:09.299, 1.1.-1.1.1, root, hli0, move, 7982501, w
arn, 3992, "Warning from device", Data=>rewindUnload<resultSeve
rity>warn6434<!|CDATA|driv
e 1,1,-1,1,1: rewindUnload Successful with mediaError: Cartridge Label: , FSC:
377A||>000ult>

----------------

acsss_event.log:

2014-01-16 00:24:13 DISMOUNT[0]:
2146 I mt_action_dm.c 1 424
Fault Symptom Code (FSC) 3961 reported when dismounting volume TC1629 from
drive 1, 0, 1, 4.

2014-01-16 05:21:21 DISMOUNT[0]:
2146 I mt_action_dm.c 1 424
Fault Symptom Code (FSC) 377A reported when dismounting volume TC1629 from
drive 1, 0, 1, 4.

----------------

backup-serverin tape-error log :

01/16/2014,00:21:27,pid=8781842,close,/dev/rmt/drive5,2W.0306:13:TC1629,(110) Media surface error

===============================================================================================

A forced dump after such failure reported by the customer, showed 'DC FSC Trace' full of this pattern, repeating it self one after another:

dfd5ead2  3961  RO_FSC_PW_LIMIT_ERROR_DUE_TO_WITH_VR2_DATA
32e8ab59  377a  RO_FSC_READ_HDWR_NOT_MAKING_PROGRESS    
32ffae43  377a  RO_FSC_READ_HDWR_NOT_MAKING_PROGRESS    
3301ae8f  377a  RO_FSC_READ_HDWR_NOT_MAKING_PROGRESS    
7925e4dc  3200  CC_FSC_LAST_FSC_FOR_THIS_OP

What happens here is that the 3961 is the actual write error, and 377A is that a symptom from that. This is the finger print to this issue.

Changes

Installation of T10000D drives.

Cause

Issues with humidity in the data center.
It was 14,2% with 24,6 Celsius degrees.

Solution

Specifications says 20-80% and engineering recommends at least 40%.

Fix data center humidity levels it was around 40% .

Problem is solved.

Attachments

This solution has no attachment