Oracle ZFS Storage Appliance: On Upgrade, All 'ixgbe-based' LACP Interfaces are 'Lost'

Asset ID:	1-72-2000091.1
Update Date:	2018-05-30
Keywords:

Solution Type Problem Resolution Sure

Solution 2000091.1 : Oracle ZFS Storage Appliance: On Upgrade, All 'ixgbe-based' LACP Interfaces are 'Lost'

Applies to:

Oracle ZFS Storage ZS3-2 - Version All Versions and later
Sun ZFS Storage 7420 - Version All Versions and later
Sun ZFS Storage 7320 - Version All Versions and later
Sun ZFS Storage 7120 - Version All Versions and later
Oracle ZFS Storage ZS3-4 - Version All Versions and later
7000 Appliance OS (Fishworks)

Symptoms

LACP aggrs are unavailable after a reboot.

When the customer reboots the first head being upgraded,it becomes stripped - it is then upgraded.

When a takeover is subsequently done, the upgraded head takes ownership of all resources.

At this point, the upgraded head can no longer be seen on the 10Gbe LACP aggrs.

before reboot - dladm show-aggr -L

LINK PORT AGGREGATABLE SYNC COLL DIST DEFAULTED EXPIRED
aggr2 ixgbe2 yes yes yes yes no no
-- ixgbe0 yes yes yes yes no no
-- ixgbe1 yes yes yes yes no no
aggr1 ixgbe4 yes yes yes yes no no
-- ixgbe5 yes yes yes yes no no
-- ixgbe3 yes yes yes yes no no

after reboot - dladm show-aggr -L

LINK PORT AGGREGATABLE SYNC COLL DIST DEFAULTED EXPIRED
aggr1 ixgbe4 yes no no no no no
-- ixgbe5 yes no no no no no
-- ixgbe3 yes no no no no no
aggr2 ixgbe2 yes no no no no no
-- ixgbe0 yes no no no no no
-- ixgbe1 yes no no no no no

Cause

This is an issue with the Cisco switch. Please reference this issue in the Cisco TAC KB or contact them for more information.

"CSCuq23178 (LACP enhancement in link down event handling)"

Solution

The immediate solution is to rebuild the LCAP aggregates in the BUI.

The customer should get their networking team involved to examine the switch. We have no details on the switch side.

***Checked for relevance on 30-MAY-2018***

Attachments

This solution has no attachment