Brocade 5100 FC Switch FOS 6.4.1b with port in "Disabled (Switch not ready for F or L ports)" state after servers attached to those ports were rebooted

Asset ID:	1-72-1517391.1
Update Date:	2013-09-24
Keywords:

Solution Type Problem Resolution Sure

Solution 1517391.1 : Brocade 5100 FC Switch FOS 6.4.1b with port in "Disabled (Switch not ready for F or L ports)" state after servers attached to those ports were rebooted

Applies to:

Brocade 5100 Switch - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

2 Brocade 5100 FC Switch FOS 6.4.1b with port in "Disabled (Switch not ready for F or L ports)" state after servers attached to those ports were rebooted.

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk/Tape Storage Area Networks

Changes

Hosts or devices connected to these ports were rebooted before issue occured.

Cause

Similar to known defect DEFECT00078592 found in Fabric OS: v5.2.0a

The problem usually appears when the devices are not able to complete the FLOGI process due to bug in firmware or some other reason.

Issue is same as an previous Oracle SR 3-6087281601.

Cause of issue in this SR:

A inconsistency between 'fabricshow' and 'topologyshow' which caused issue.

fabricshow' list 10 domains but topologyshow only list 9 domains.

Looking at supportsave data for both "FC1-SAN" and "FC2-SAN" Brocade 5100 fc switches we see same situation:

=====================
FC1-SAN
=====================

$
$ vi FC1-SAN-S0cp-201301041940.SSHOW_FABRIC.txt
"FC1-SAN-S0cp-201301041940.SSHOW_FABRIC.txt" 9234 lines, 547650 characters
Non-VF
======================
fabricshow :
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-------------------------------------------------------------------------
  3: fffc03 10:00:00:05:33:5c:e8:49 10.131.116.46 0.0.0.0 "BC4-CORPO-SWF1"
  5: fffc05 10:00:00:05:33:7c:14:08 10.131.116.56 0.0.0.0 "BC5-CORPO-SWF1"
  9: fffc09 10:00:00:27:f8:04:ec:33 10.131.116.96 0.0.0.0 "bc9-corpo-sf1"
12: fffc0c 10:00:00:05:1e:09:74:3d 10.131.6.14 0.0.0.0 >"FC1-SAN"
15: fffc0f 10:00:00:05:33:fc:27:bc 10.131.116.207 0.0.0.0 "fc15-san"
61: fffc3d 10:00:00:27:f8:04:ec:11 10.131.116.66 0.0.0.0 "bc6-corpo-swf1"
71: fffc47 10:00:00:27:f8:05:28:9f 10.131.116.76 0.0.0.0 "bc7-corpo-swf1"
81: fffc51 10:00:00:27:f8:05:2d:92 10.131.116.86 0.0.0.0 "bc8-corpo-swf1"
92: fffc5c 20:0b:00:05:73:cc:63:c1
200: fffcc8 10:00:00:05:1e:9a:3d:bb 10.131.5.120 0.0.0.0 "BC5-NOR-SWF1"

The Fabric has 10 switches

real 0m0.473s
user 0m0.420s
sys 0m0.040s

dom :
*********dom:

Number of domains: 9

3, 5, 9, 12, 15, 61, 71, 81, 200

real 0m0.438s
user 0m0.410s
sys 0m0.030s

...

topologyshow -1 :

9 domain(s) in the fabric; Local Domain ID: 12

Following domains does not list Enet IP Addr, FC IP Addr or Name:

Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-------------------------------------------------------------------------
92: fffc5c 20:0b:00:05:73:cc:63:c1

We see it in switchshow as well:

$
$ vi FC1-SAN-S0cp-201301041942.SSHOW_SYS.txt
"FC1-SAN-S0cp-201301041942.SSHOW_SYS.txt" 3839 lines, 150340 characters
...
switchshow:
switchshow :
switchName: FC1-SAN
switchType: 66.1
switchState: Online
switchMode: Native
switchRole: Principal
switchDomain: 12
switchId: fffc0c
switchWwn: 10:00:00:05:1e:09:74:3d
zoning: ON (Odd)
switchBeacon: OFF
FC Router: OFF
FC Router BB Fabric ID: 1
Address Mode: 0

Index Port Address Media Speed State Proto
==============================================
...
35 35 0c2300 id N4 Online FC E-Port 20:0b:00:05:73:cc:63:c1 "" (downstream)
36 36 0c2400 id N4 Online FC E-Port 10:00:00:05:33:fc:27:bc "fc15-san" (downstream)
37 37 0c2500 id N4 Online FC E-Port 10:00:00:05:33:fc:27:bc "fc15-san"
38 38 0c2600 id N4 Online FC E-Port 10:00:00:05:33:fc:27:bc "fc15-san"
39 39 0c2700 id N4 Online FC E-Port 10:00:00:05:33:fc:27:bc "fc15-san"

real 0m0.501s
user 0m0.470s
sys 0m0.030s

port 35 does not list the name of the attached switch like the others.

=====================
FC2-SAN
=====================

$
$ vi FC2-SAN-S0cp-201301041920.SSHOW_FABRIC.txt
"FC2-SAN-S0cp-201301041920.SSHOW_FABRIC.txt" 8051 lines, 490843 characters
VF
======================
fabricshow :
CURRENT CONTEXT -- 0 , 128
Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-------------------------------------------------------------------------
  1: fffc01 10:00:00:05:33:4f:14:32 10.131.116.47 0.0.0.0 "BC4-CORPO-SWF2"
  5: fffc05 10:00:00:05:33:7f:ff:fe 10.131.116.57 0.0.0.0 "BC5-CORPO-SWF2"
10: fffc0a 10:00:00:27:f8:05:2d:a3 10.131.116.97 0.0.0.0 "bc9-corpo-sf2"
16: fffc10 10:00:00:05:33:ee:cb:05 10.131.116.208 0.0.0.0 "FC16-SAN"
25: fffc19 10:00:00:05:1e:e7:4d:f7 10.131.6.15 0.0.0.0 >"FC2-SAN"
56: fffc38 20:15:00:05:73:cc:63:c1
62: fffc3e 10:00:00:27:f8:04:ec:be 10.131.116.67 0.0.0.0 "bc6-corpo-swf2"
72: fffc48 10:00:00:27:f8:05:2a:b8 10.131.116.77 0.0.0.0 "bc7-corpo-swf2"
82: fffc52 10:00:00:27:f8:05:28:a6 10.131.116.87 0.0.0.0 "bc8-corpo-swf2"
201: fffcc9 10:00:00:05:1e:9c:1e:d1 10.131.5.121 0.0.0.0 "BC5-NOR-SWF2"

The Fabric has 10 switches

real 0m0.476s
user 0m0.410s
sys 0m0.020s

dom :
CURRENT CONTEXT -- 0 , 128
*********dom:

Number of domains: 9

1, 5, 10, 16, 25, 62, 72, 82, 201

real 0m0.437s
user 0m0.400s
sys 0m0.040s

...

topologyshow -1 :
CURRENT CONTEXT -- 0 , 128

9 domain(s) in the fabric; Local Domain ID: 25

...

Following domains does not list Enet IP Addr, FC IP Addr or Name:

Switch ID Worldwide Name Enet IP Addr FC IP Addr Name
-------------------------------------------------------------------------
56: fffc38 20:15:00:05:73:cc:63:c1

$
$ vi FC2-SAN-S0cp-201301041922.SSHOW_SYS.txt
"FC2-SAN-S0cp-201301041922.SSHOW_SYS.txt" 3497 lines, 141521 characters
...
switchshow:
switchshow :
CURRENT CONTEXT -- 0 , 128
switchName: FC2-SAN
switchType: 66.1
switchState: Online
switchMode: Native
switchRole: Principal
switchDomain: 25
switchId: fffc19
switchWwn: 10:00:00:05:1e:e7:4d:f7
zoning: ON (even)
switchBeacon: OFF
FC Router: OFF
Allow XISL Use: OFF
LS Attributes: [FID: 128, Base Switch: No, Default Switch: Yes, Address Mode 0]

Index Port Address Media Speed State Proto
==============================================
...
36 36 192400 id N4 Online FC E-Port 10:00:00:05:33:ee:cb:05 "FC16-SAN"
37 37 192500 id N4 Online FC E-Port 10:00:00:05:33:ee:cb:05 "FC16-SAN"
38 38 192600 id N4 Online FC F-Port 21:00:00:1b:32:9d:39:4c
39 39 192700 id N4 Online FC E-Port 20:15:00:05:73:cc:63:c1 "" (downstream)

real 0m0.522s
user 0m0.470s
sys 0m0.060s

Port #39 does not list the name of the attached switch like the others.

Solution

Do a fabric reconfiguration by disabling/enabling ISL ports to cause a fabric reconfiguration.

"FC1-SAN" port 35

"FC2-SAN" port 38

On a switch with FOS v5.2.X :

- The fix for Brocade DEFECT00078592 found in Fabric OS: v5.2.0a is provided on FOS 6.1.X, see this thread:

http://community.brocade.com/thread/4684

- When the problem is present on a switch with FOS 5.2.X, the workaround is to reboot the FC switch.

As internal note: DEFECT000078592 is not listed on any FOS Release Notes:
We have asked Brocade about this Defect before and this was their response

"Regarding DEFECT000078592; we encountered the defect during internal testing for one of the preliminary builds for FOS v5.2.1. The preliminary build was a test build prior to GA release of FOS v5.2.1. That is why you will not see the defect listed in the FOS Release Notes."

Attachments

This solution has no attachment