Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-72-2262231.1
Update Date:2017-05-05
Keywords:
Solution Type  Problem Resolution Sure

Solution  2262231.1 :   Solaris 11.3 - New LUN Mapped Not Visible in format - devfsadm failed to lookup dev name for  

Related Items 
    

  • SPARC T7-1
    •  
  • Solaris Operating System
    •  
Related Categories 
    

  • PLA-Support>Sun Systems>DISK>Storage Drivers>SN-DK: Storage Drivers
    •  






In this Document


Symptoms


Cause


Solution


References

Created from <SR 3-14463173591>


Applies to:  

SPARC T7-1 - Version All Versions and later
Solaris Operating System - Version 11.3 and later
Information in this document applies to any platform.



Symptoms


This is a Solaris 11.3 SRU 13.4.0 control domain T7-1 sever with two Oracle Qlogic 16GB FC HBAs, 
two ports connected to the SAN to access an Hitachi storage array



c4 = qlc0 (fp8) -> /devices/pci@301/pci@1/SUNW,qlc@0/fp@0,0:devctl
================================================================================
 Port_ID Port WWN Device Description Type
 ------- -------- ------------------ ----
 3YY00 50060e8013XXXX50 -> HDS:  (Disk device)
 3XX00 2100000e1XXXXXb0 -> QLogic HBA: Port 1 (Unknown Type,Host Bus Adapter)


c12 = qlc2 (fp4) -> /devices/pci@304/pci@1/SUNW,qlc@0/fp@0,0:devctl
================================================================================
 Port_ID Port WWN Device Description Type
 ------- -------- ------------------ ----
 2YY00 50060e8013XXXX40 -> HDS: (Disk device)
 2XX00 2100000e1XXXXX80 -> QLogic HBA: Port 1 (Unknown Type,Host Bus Adapter)



We are mapping some new LUNs from an Hitachi storage array (0x19 = 25, 0x18 = 24 and 0x17 = 23) , at that time on the messages we can see new LUNs come online , but devfsadm reports an error:





Mar 11 14:57:37 server01 scsi: [ID 583861 kern.notice] ssd55 at scsi_vhci0: unit-address g60060e8013XXXX005020XXXX0000021e: f_sym
Mar 11 14:57:37 server01 genunix: [ID 936769 kern.notice] ssd55 is /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021e
Mar 11 14:57:37 server01 cmlb: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021e (ssd55):
Mar 11 14:57:37 server01 Corrupt label; wrong magic number
Mar 11 14:57:37 server01 genunix: [ID 408114 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021e (ssd55) online
Mar 11 14:57:37 server01 genunix: [ID 483743 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021e (ssd55) multipath status: degraded: path 51 fp8/ssd@w50060e8013XXXX50,19 is online


Mar 11 14:57:37 server01 scsi: [ID 583861 kern.notice] ssd56 at scsi_vhci0: unit-address g60060e8013XXXX005020XXXX0000021d: f_sym
Mar 11 14:57:37 server01 genunix: [ID 936769 kern.notice] ssd56 is /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021d
Mar 11 14:57:37 server01 cmlb: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021d (ssd56):
Mar 11 14:57:37 server01 Corrupt label; wrong magic number
Mar 11 14:57:37 server01 genunix: [ID 408114 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021d (ssd56) online
Mar 11 14:57:37 server01 genunix: [ID 483743 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021d (ssd56) multipath status: degraded: path 52 fp8/ssd@w50060e8013XXXX50,18 is online


Mar 11 14:57:37 server01 scsi: [ID 583861 kern.notice] ssd57 at scsi_vhci0: unit-address g60060e8013XXXX005020XXXX0000021b: f_sym
Mar 11 14:57:37 server01 genunix: [ID 936769 kern.notice] ssd57 is /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021b
Mar 11 14:57:37 server01 cmlb: [ID 107833 kern.warning] WARNING: /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021b (ssd57):
Mar 11 14:57:37 server01 Corrupt label; wrong magic number
Mar 11 14:57:37 server01 genunix: [ID 408114 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021b (ssd57) online
Mar 11 14:57:37 server01 genunix: [ID 483743 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021b (ssd57) multipath status: degraded: path 53 fp8/ssd@w50060e8013XXXX50,17 is online


Mar 11 14:57:37 server01 devfsadmd[264]: [ID 534846 daemon.error] minor_init failed for module /usr/lib/devfsadm/linkmod/SUNW_disk_link.so         <<<<----????
Mar 11 14:57:37 server01 devfsadmd[264]: [ID 937045 daemon.error] failed to lookup dev name for /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021e   <<<<----????
Mar 11 14:57:37 server01 devfsadmd[264]: [ID 937045 daemon.error] failed to lookup dev name for /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021d
Mar 11 14:57:37 server01 devfsadmd[264]: [ID 937045 daemon.error] failed to lookup dev name for /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021b
Mar 11 14:57:46 server01 genunix: [ID 530209 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021e (ssd55) multipath status: optimal: path 54 fp4/ssd@w50060e8013XXXX40,19 is online: Load balancing: round-robin
Mar 11 14:57:46 server01 genunix: [ID 530209 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021d (ssd56) multipath status: optimal: path 55 fp4/ssd@w50060e8013XXXX40,18 is online: Load balancing: round-robin
Mar 11 14:57:46 server01 genunix: [ID 530209 kern.notice] /scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021b (ssd57) multipath status: optimal: path 56 fp4/ssd@w50060e8013XXXX40,17 is online: Load balancing: round-robin
Mar 11 14:57:51 server01 devfsadmd[264]: [ID 534846 daemon.error] minor_init failed for module /usr/lib/devfsadm/linkmod/SUNW_disk_link.so




These new LUNs are not visible on format
but other LUNs previously mapped long time ago:


5. c0t60060E8013XXXX005020XXXX0000021Ad0
/scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021a
6. c0t60060E8013XXXX005020XXXX0000020Ad0
/scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000020a
...
25. c0t60060E8013XXXX005020XXXX00000205d0
/scsi_vhci/ssd@g60060e8013XXXX005020XXXX00000205


-bash-4.1$ grep -i 60060e8013XXXX005020XXXX0000021e format.out
-bash-4.1$ grep -i 60060e8013XXXX005020XXXX0000021d format.out
-bash-4.1$ grep -i 60060e8013XXXX005020XXXX0000021b format.out


By the other hand, device files have been created on the device tree under /devices/scsi_vhci for these new LUNs:




-bash-4.1$ grep -i 60060e8013XXXX005020XXXX0000021e *
ls_-lAR_@dev_@devices.out:drwxr-xr-x 2 root sys 2 Mar 11 14:57 ssd@g60060e8013XXXX005020XXXX0000021e
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 440 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:a
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 440 Mar 11 14:58 ssd@g60060e8013XXXX005020XXXX0000021e:a,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 441 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:b
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 441 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:b,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 442 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:c
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 442 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:c,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 443 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:d
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 443 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:d,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 444 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:e
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 444 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:e,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 445 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:f
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 445 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:f,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 446 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:g
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 446 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:g,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 447 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:h
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 447 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021e:h,raw
ls_-lAR_@dev_@devices.out:/devices/scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021e:
-bash-4.1$


-bash-4.1$ grep -i 60060e8013XXXX005020XXXX0000021d *
ls_-lAR_@dev_@devices.out:drwxr-xr-x 2 root sys 2 Mar 11 14:57 ssd@g60060e8013XXXX005020XXXX0000021d
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 448 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:a
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 448 Mar 11 14:58 ssd@g60060e8013XXXX005020XXXX0000021d:a,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 449 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:b
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 449 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:b,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 450 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:c
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 450 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:c,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 451 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:d
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 451 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:d,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 452 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:e
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 452 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:e,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 453 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:f
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 453 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:f,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 454 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:g
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 454 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:g,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 455 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:h
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 455 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021d:h,raw
ls_-lAR_@dev_@devices.out:/devices/scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021d:


-bash-4.1$ grep -i 60060e8013XXXX005020XXXX0000021b *
ls_-lAR_@dev_@devices.out:drwxr-xr-x 2 root sys 2 Mar 11 14:57 ssd@g60060e8013XXXX005020XXXX0000021b
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 456 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:a
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 456 Mar 11 14:58 ssd@g60060e8013XXXX005020XXXX0000021b:a,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 457 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:b
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 457 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:b,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 458 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:c
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 458 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:c,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 459 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:d
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 459 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:d,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 460 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:e
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 460 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:e,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 461 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:f
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 461 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:f,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 462 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:g
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 462 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:g,raw
ls_-lAR_@dev_@devices.out:brw-r----- 1 root sys 245, 463 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:h
ls_-lAR_@dev_@devices.out:crw-r----- 1 root sys 245, 463 Mar 11 15:23 ssd@g60060e8013XXXX005020XXXX0000021b:h,raw
ls_-lAR_@dev_@devices.out:/devices/scsi_vhci/ssd@g60060e8013XXXX005020XXXX0000021b:
-bash-4.1$




 


These are correctly configured under cfgadm :




c4::50060e8013XXXX50,23 disk connected configured unknown
c4::50060e8013XXXX50,24 disk connected configured unknown
c4::50060e8013XXXX50,25 disk connected configured unknown


c12::50060e8013XXXX40,23 disk connected configured unknown
c12::50060e8013XXXX40,24 disk connected configured unknown
c12::50060e8013XXXX40,25 disk connected configured unknown




 


Cause


Most likely we are hitting this known bug:
Bug 24699872 - devfsadm: minor_init failed for module SUNW_disk_link.so again 
--> Fix delivered in Oracle Solaris 11.3.18.6.0 (or greater)
 




This Bug 24699872: devfsadm: minor_init failed for module SUNW_disk_link.so again
explains that this is a regression introduced by the fix for this other bug 19683601 
Bug 19683601 - lofi sync and async link generation race against each other
The fix for bug 19683601 enhanced devfsadm , and it was delivered in Oracle Solaris 11.3.0.30.0 (or greater)


So it seems this new issue is affecting since Solaris 11.3 , 
I have seen reported this same problem on other customers with Solaris 11.3 servers




 


Solution


Workaround: Reboot the Solaris server.

Solution: Upgrade to Solaris 11.3 SRU 18.6.0 version (or greater) and reboot.



For existing Solaris 11.3 SRU versions see:


Oracle Solaris 11.3 Support Repository Updates (SRU) Index (Doc ID 2045311.1) 


 


References
<NOTE:1639040.1> - Executing devfsadm will not add or recreate any missing links in /dev/dsk or /dev/rdsk
 <BUG:24699872> - DEVFSADM: MINOR_INIT FAILED FOR MODULE SUNW_DISK_LINK.SO AGAIN
<NOTE:2045311.1> - Oracle Solaris 11.3 Support Repository Updates (SRU) Index



Attachments

This solution has no attachment


















       

Copyright © 2018 Oracle, Inc.  All rights reserved.

 Feedback