Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-72-1672343.1
Update Date:2016-07-29
Keywords:

Solution Type  Problem Resolution Sure

Solution  1672343.1 :   Invalid DWord Count, Running Disparity Error Count, and Loss of DWord Synch Count Logged By SAS Expander During Server Reboot  


Related Items
  • Solaris Operating System
  •  
  • Sun Flash F5100 Array
  •  
Related Categories
  • PLA-Support>Sun Systems>DISK>Storage Drivers>SN-DK: Storage Drivers
  •  




In this Document
Symptoms
Cause
Solution
References


Created from <SR 3-8231989621>

Applies to:

Solaris Operating System - Version 10 10/09 U8 and later
Sun Flash F5100 Array - Version All Versions and later
Information in this document applies to any platform.

Symptoms

For example, from a Sun Server X2-4 (Sun Fire X4470 M2) with a SGX-SAS6-EXT-Z 8-Port 6Gbps SAS-2 PCI Express HBA (LSI) connected to Sun Storage F5100 Flash Array.

System Configuration: Oracle Corporation SUN FIRE X4470 M2 SERVER
BIOS Configuration: American Megatrends Inc. 16040200 02/12/2013
Oracle Solaris 10 1/13 s10x_u11wos_24a X86

:vendor-id     0x1000
:revision-id   0x3
:class-code    0x10700
:unit-address  0
:subsystem-id  0x30b0
:subsystem-vendor-id   0x1000
:interrupts    0x1
:devsel-speed  0
:model         Serial Attached SCSI Controller
:firmware-version      11.5.3.0
:num-phys      0x8

 

From LSI utility:

LSI Logic MPT Configuration Utility, Version 1.66, February 24, 2011

1 MPT Port found

     Port Name         Chip Vendor/Type/Rev    MPT Rev  Firmware Rev  IOC
 1.  mpt_sas0          LSI Logic SAS2008 B2      200      0b050300     0

Select a device:  [1-1 or 0 to quit] 1

 1.  Identify firmware, BIOS, and/or FCode
 2.  Download firmware (update the FLASH)
 4.  Download/erase BIOS and/or FCode (update the FLASH)
 8.  Scan for devices
10.  Change IOC settings (interrupt coalescing)
13.  Change SAS IO Unit settings
16.  Display attached devices
20.  Diagnostics
21.  RAID actions
23.  Reset target
42.  Display operating system names for devices
43.  Diagnostic Buffer actions
45.  Concatenate SAS firmware and NVDATA files
59.  Dump PCI config space
60.  Show non-default settings
61.  Restore default settings
66.  Show SAS discovery errors
69.  Show board manufacturing information
97.  Reset SAS link, HARD RESET
98.  Reset SAS link
99.  Reset port
 e   Enable expert mode in menus
 p   Enable paged mode
 w   Enable logging

Main menu, select an option:  [1-99 or e/p/w or 0 to quit] 20

 1.  Inquiry Test
 2.  WriteBuffer/ReadBuffer/Compare Test
 3.  Read Test
 4.  Write/Read/Compare Test
 8.  Read Capacity / Read Block Limits Test
12.  Display phy counters
13.  Clear phy counters
14.  SATA SMART Read Test
15.  SEP (SCSI Enclosure Processor) Test

18.  Report LUNs Test
19.  Drive firmware download
20.  Expander firmware download
21.  Read Logical Blocks
99.  Reset port
 e   Enable expert mode in menus
 p   Enable paged mode
 w   Enable logging

Diagnostics menu, select an option:  [1-99 or e/p/w or 0 to quit] 12

Adapter Phy 0:  Link Up, No Errors

Adapter Phy 1:  Link Up, No Errors

Adapter Phy 2:  Link Up, No Errors

Adapter Phy 3:  Link Up, No Errors

Adapter Phy 4:  Link Down, No Errors

Adapter Phy 5:  Link Down, No Errors

Adapter Phy 6:  Link Down, No Errors

Adapter Phy 7:  Link Down, No Errors

Expander (Handle 0009) Phy 0:  Link Up, No Errors

Expander (Handle 0009) Phy 1:  Link Up, No Errors

Expander (Handle 0009) Phy 2:  Link Up, No Errors

Expander (Handle 0009) Phy 3:  Link Up, No Errors

Expander (Handle 0009) Phy 4:  Link Up, No Errors

Expander (Handle 0009) Phy 5:  Link Up, No Errors

Expander (Handle 0009) Phy 6:  Link Up, No Errors

Expander (Handle 0009) Phy 7:  Link Up, No Errors

Expander (Handle 0009) Phy 8:  Link Up, No Errors

Expander (Handle 0009) Phy 9:  Link Up, No Errors

Expander (Handle 0009) Phy 10:  Link Up, No Errors

Expander (Handle 0009) Phy 11:  Link Up, No Errors

Expander (Handle 0009) Phy 12:  Link Down, No Errors

Expander (Handle 0009) Phy 13:  Link Up, No Errors

Expander (Handle 0009) Phy 14:  Link Up, No Errors

Expander (Handle 0009) Phy 15:  Link Up, No Errors

Expander (Handle 0009) Phy 16:  Link Up, No Errors

Expander (Handle 0009) Phy 17:  Link Up, No Errors

Expander (Handle 0009) Phy 18:  Link Up, No Errors

Expander (Handle 0009) Phy 19:  Link Up, No Errors

Expander (Handle 0009) Phy 20:  Link Down, No Errors

Expander (Handle 0009) Phy 21:  Link Down, No Errors

Expander (Handle 0009) Phy 22:  Link Down, No Errors

Expander (Handle 0009) Phy 23:  Link Down, No Errors

Expander (Handle 0009) Phy 24:  Link Down, No Errors

Expander (Handle 0009) Phy 25:  Link Down, No Errors

Expander (Handle 0009) Phy 26:  Link Down, No Errors

Expander (Handle 0009) Phy 27:  Link Down, No Errors

Expander (Handle 0009) Phy 28:  Link Up
  Invalid DWord Count                                   1,381,127
  Running Disparity Error Count                         1,341,649
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

Expander (Handle 0009) Phy 29:  Link Up
  Invalid DWord Count                                   1,374,122
  Running Disparity Error Count                         1,339,739
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

Expander (Handle 0009) Phy 30:  Link Up
  Invalid DWord Count                                   1,234,944
  Running Disparity Error Count                         1,180,630
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

Expander (Handle 0009) Phy 31:  Link Up
  Invalid DWord Count                                   1,366,866
  Running Disparity Error Count                         1,305,454
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

Expander (Handle 0009) Phy 32:  Link Down, No Errors

Expander (Handle 0009) Phy 33:  Link Down, No Errors

Expander (Handle 0009) Phy 34:  Link Down, No Errors

Expander (Handle 0009) Phy 35:  Link Down, No Errors

Expander (Handle 0009) Phy 36:  Link Up, No Errors

Expander (Handle 0009) Phy 37:  Link Down, No Errors

Diagnostics menu, select an option:  [1-99 or e/p/w or 0 to quit] 13

Adapter Phy 0 counters have been cleared
Adapter Phy 1 counters have been cleared
Adapter Phy 2 counters have been cleared
Adapter Phy 3 counters have been cleared
Adapter Phy 4 counters have been cleared
Adapter Phy 5 counters have been cleared
Adapter Phy 6 counters have been cleared
Adapter Phy 7 counters have been cleared
Expander (Handle 0009) Phy 0 counters have been cleared
Expander (Handle 0009) Phy 1 counters have been cleared
Expander (Handle 0009) Phy 2 counters have been cleared
Expander (Handle 0009) Phy 3 counters have been cleared
Expander (Handle 0009) Phy 4 counters have been cleared
Expander (Handle 0009) Phy 5 counters have been cleared
Expander (Handle 0009) Phy 6 counters have been cleared
Expander (Handle 0009) Phy 7 counters have been cleared
Expander (Handle 0009) Phy 8 counters have been cleared
Expander (Handle 0009) Phy 9 counters have been cleared
Expander (Handle 0009) Phy 10 counters have been cleared
Expander (Handle 0009) Phy 11 counters have been cleared
Expander (Handle 0009) Phy 12 counters have been cleared
Expander (Handle 0009) Phy 13 counters have been cleared
Expander (Handle 0009) Phy 14 counters have been cleared
Expander (Handle 0009) Phy 15 counters have been cleared
Expander (Handle 0009) Phy 16 counters have been cleared
Expander (Handle 0009) Phy 17 counters have been cleared
Expander (Handle 0009) Phy 18 counters have been cleared
Expander (Handle 0009) Phy 19 counters have been cleared
Expander (Handle 0009) Phy 20 counters have been cleared
Expander (Handle 0009) Phy 21 counters have been cleared
Expander (Handle 0009) Phy 22 counters have been cleared
Expander (Handle 0009) Phy 23 counters have been cleared
Expander (Handle 0009) Phy 24 counters have been cleared
Expander (Handle 0009) Phy 25 counters have been cleared
Expander (Handle 0009) Phy 26 counters have been cleared
Expander (Handle 0009) Phy 27 counters have been cleared
Expander (Handle 0009) Phy 28 counters have been cleared
Expander (Handle 0009) Phy 29 counters have been cleared
Expander (Handle 0009) Phy 30 counters have been cleared
Expander (Handle 0009) Phy 31 counters have been cleared
Expander (Handle 0009) Phy 32 counters have been cleared
Expander (Handle 0009) Phy 33 counters have been cleared
Expander (Handle 0009) Phy 34 counters have been cleared
Expander (Handle 0009) Phy 35 counters have been cleared
Expander (Handle 0009) Phy 36 counters have been cleared
Expander (Handle 0009) Phy 37 counters have been cleared

Diagnostics menu, select an option:  [1-99 or e/p/w or 0 to quit] 12

Adapter Phy 0:  Link Up, No Errors

Adapter Phy 1:  Link Up, No Errors

Adapter Phy 2:  Link Up, No Errors

Adapter Phy 3:  Link Up, No Errors

Adapter Phy 4:  Link Down, No Errors

Adapter Phy 5:  Link Down, No Errors

Adapter Phy 6:  Link Down, No Errors

Adapter Phy 7:  Link Down, No Errors

Expander (Handle 0009) Phy 0:  Link Up, No Errors

Expander (Handle 0009) Phy 1:  Link Up, No Errors

Expander (Handle 0009) Phy 2:  Link Up, No Errors

Expander (Handle 0009) Phy 3:  Link Up, No Errors

Expander (Handle 0009) Phy 4:  Link Up, No Errors

Expander (Handle 0009) Phy 5:  Link Up, No Errors

Expander (Handle 0009) Phy 6:  Link Up, No Errors

Expander (Handle 0009) Phy 7:  Link Up, No Errors

Expander (Handle 0009) Phy 8:  Link Up, No Errors

Expander (Handle 0009) Phy 9:  Link Up, No Errors

Expander (Handle 0009) Phy 10:  Link Up, No Errors

Expander (Handle 0009) Phy 11:  Link Up, No Errors

Expander (Handle 0009) Phy 12:  Link Down, No Errors

Expander (Handle 0009) Phy 13:  Link Up, No Errors

Expander (Handle 0009) Phy 14:  Link Up, No Errors

Expander (Handle 0009) Phy 15:  Link Up, No Errors

Expander (Handle 0009) Phy 16:  Link Up, No Errors

Expander (Handle 0009) Phy 17:  Link Up, No Errors

Expander (Handle 0009) Phy 18:  Link Up, No Errors

Expander (Handle 0009) Phy 19:  Link Up, No Errors

Expander (Handle 0009) Phy 20:  Link Down, No Errors

Expander (Handle 0009) Phy 21:  Link Down, No Errors

Expander (Handle 0009) Phy 22:  Link Down, No Errors

Expander (Handle 0009) Phy 23:  Link Down, No Errors

Expander (Handle 0009) Phy 24:  Link Down, No Errors

Expander (Handle 0009) Phy 25:  Link Down, No Errors

Expander (Handle 0009) Phy 26:  Link Down, No Errors

Expander (Handle 0009) Phy 27:  Link Down, No Errors

Expander (Handle 0009) Phy 28:  Link Up, No Errors

Expander (Handle 0009) Phy 29:  Link Up, No Errors

Expander (Handle 0009) Phy 30:  Link Up, No Errors

Expander (Handle 0009) Phy 31:  Link Up, No Errors

Expander (Handle 0009) Phy 32:  Link Down, No Errors

Expander (Handle 0009) Phy 33:  Link Down, No Errors

Expander (Handle 0009) Phy 34:  Link Down, No Errors

Expander (Handle 0009) Phy 35:  Link Down, No Errors

Expander (Handle 0009) Phy 36:  Link Up, No Errors

Expander (Handle 0009) Phy 37:  Link Down, No Errors

Diagnostics menu, select an option:  [1-99 or e/p/w or 0 to quit]

 

Counters will remain at zero until reboot...

LSI Logic MPT Configuration Utility, Version 1.66, February 24, 2011

1 MPT Port found

     Port Name         Chip Vendor/Type/Rev    MPT Rev  Firmware Rev  IOC
 1.  mpt_sas0          LSI Logic SAS2008 B2      200      0b050300     0

...

Expander (Handle 0009) Phy 28:  Link Up
  Invalid DWord Count                                   1,467,157
  Running Disparity Error Count                         1,422,324
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

Expander (Handle 0009) Phy 29:  Link Up
  Invalid DWord Count                                   1,457,503
  Running Disparity Error Count                         1,430,255
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

Expander (Handle 0009) Phy 30:  Link Up
  Invalid DWord Count                                   1,310,946
  Running Disparity Error Count                         1,253,380
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

Expander (Handle 0009) Phy 31:  Link Up
  Invalid DWord Count                                   1,453,297
  Running Disparity Error Count                         1,388,061
  Loss of DWord Synch Count                                     2
  Phy Reset Problem Count                                       0

...
 

 

Cause

Avago Technologies/LSI has finally confirmed this is working as designed. The links will drop when the operating system is reset and the expander will log the SAS link dropping along with the associated errors.

Solution

As long as the expander errors do not continue to increase after the reboot has completed, the errors should just be ignored. As the expander errors are only visible from an engineering utility, there should be no requirement to document this issue further.
 

References

<BUG:18492549> - ERRORS LOGGED BY EXPANDER DURING SERVER REBOOT

Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback