Sun Storage 7000 Unified Storage System: Default route vanishes on one cluster node when network configuration is changed on other node.

Asset ID:	1-72-1321373.1
Update Date:	2013-07-24
Keywords:

Solution Type Problem Resolution Sure

Solution 1321373.1 : Sun Storage 7000 Unified Storage System: Default route vanishes on one cluster node when network configuration is changed on other node.

Applies to:

Sun Storage 7410 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7420 - Version Not Applicable to Not Applicable [Release N/A]
Sun Storage 7310 Unified Storage System - Version Not Applicable to Not Applicable [Release N/A]
Sun ZFS Storage 7320 - Version Not Applicable to Not Applicable [Release N/A]
7000 Appliance OS (Fishworks)
NAS head revision : [2010.Q3 and below]
BIOS revision : [not dependent]
ILOM revision : [not dependent]
Cluster Issue : [yes]

Symptoms

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance Community

Changing network configuration "Allow Administration" on one node, the default route setting vanishes on other node. It causes loads of network problem including imapd, ldap, httpd.

Before changing the network config on one node, other node config is as follows:

Appliance:> configuration net routing show
Properties:
multihoming = loose

Routes:

ROUTE     DESTINATION    GATEWAY        INTERFACE    TYPE
route-000 0.0.0.0/0    134.178.144.238   ipmp2      static
route-001 134.178.144.224 134.178.144.227   ipmp2    system
route-002 134.178.144.224 134.178.144.225   nxge251000 system
route-003 134.178.144.224 134.178.144.226   nxge251001 system
route-004 172.16.0.0    172.16.151.250    nge1 system
route-005 172.16.151.0 172.16.151.16     nge1       system

But after changing, the default route is lost.

Appliance:> configuration net routing show
Properties:
multihoming = loose

Routes:

ROUTE   DESTINATION    GATEWAY    INTERFACE    TYPE
route-000 134.178.144.224 134.178.144.227   ipmp2    system
route-001 134.178.144.224 134.178.144.225   nxge251000 system
route-002 134.178.144.224 134.178.144.226   nxge251001 system
route-003 172.16.0.0     172.16.151.250    nge1     system
route-004 172.16.151.0     172.16.151.16     nge1       system

The routing table can also be seen from the OS shell using:

# netstat -rn

or from the support bundle in the net/netstat-rn.out file.

The output before changing the network config looks like:

Routing Table:

IPv4 Destination Gateway Flags Ref Use Interface

-------------------- -------------------- ----- ----- ---------- ---------

default 134.178.144.238 UG 5 45717 ipmp2

127.0.0.1 127.0.0.1 UH 4 76494 lo0

134.178.144.224 134.178.144.227 U 3 0 ipmp2

134.178.144.224 134.178.144.225 U 3 38536 nxge251000

134.178.144.224 134.178.144.226 U 3 38536 nxge251001

172.16.0.0 172.16.151.250 UG 1 0 nge1

172.16.151.0 172.16.151.16 U 3 6359 nge1

But after changing, the default route is lost.

Routing Table: IPv4 Destination Gateway Flags Ref Use Interface

-------------------- -------------------- ----- ----- ---------- ---------

127.0.0.1 127.0.0.1 UH 4 757724 lo0

134.178.144.224 134.178.144.227 U 2 0 ipmp2

134.178.144.224 134.178.144.225 U 4 351 nxge251000

134.178.144.224 134.178.144.226 U 4 351 nxge251001

172.16.0.0 172.16.151.250 UG 1 0 nge1

172.16.151.0 172.16.151.16 U 3 3095 nge1

Changes

Changing network interface configuration "Allow Administration" on one node may trigger this problem.

Cause

The cause is a known problem in appliance software code prior to 2011.1.1.0.

CR 7003656: default route vanishes on one node when network configuration is changed on other node.

Solution

Update to appliance software release 2011.1.1.0 or later.

For 7x10 Systems with SAS-1 Disk Trays update to 2011.1.2.1 or later.

Back to <Document 1392086.1> Sun Stroage 7000 Unified Storage System: How to Troubleshoot Network Problems.

References

<NOTE:1392086.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot Network Problems
<BUG:7003656> - RFI BACKPORT OF BUG 6882551 FOR INCLUSION IN 10.1.3.3.3 (RFI #81541)

Attachments

This solution has no attachment