Oracle ZFS Storage Appliance: iSCSI target group missing from peer node

Asset ID:	1-72-2091490.1
Update Date:	2018-01-05
Keywords:

Solution Type Problem Resolution Sure

Solution 2091490.1 : Oracle ZFS Storage Appliance: iSCSI target group missing from peer node

Applies to:

Sun ZFS Storage 7120 - Version All Versions to All Versions [Release All Releases]
Sun Storage 7410 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Sun Storage 7310 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Sun Storage 7210 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-4 - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)

Symptoms

Applications team found the iSCSI storage groups are not in sync with peer head.

Example : this group is present on Node01 but not present in Node02.

configuration san iscsi targets groups:> list

Node01:
group-000 iscsi_group_0
             iqn.1986-03.com.sun:02:203e13e0-5249-6ad3-e7d0-e73416edd593
group-001 iscsi_group_1
             iqn.1986-03.com.sun:02:518112d3-dfe2-62a4-ce9d-ea560c39c39c
group-002 iscsi_group_3
             iqn.1986-03.com.sun:02:abb112f4-b45b-66cb-9c8c-def84f3f498a
group-003 iscsi_group_4
             iqn.1986-03.com.sun:02:613d38c5-7304-c9e9-f5dd-b6969ee35e41
group-004 iscsi_group_5
             iqn.1986-03.com.sun:02:c7841126-6a60-ec6e-bf95-b5394e7bf55c
group-005 iscsi_group_6
             iqn.1986-03.com.sun:02:6a00d402-c735-40f9-ae3e-d482ef0d3721

group-006 iscsi_group_7
             iqn.1986-03.com.sun:02:439aca23-6a86-e61a-b376-deccf5e5a6f7
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
group-007 iscsi_group_8
             iqn.1986-03.com.sun:02:41d29337-1d86-6d37-b34e-ac8f6eb91127

Node02:
group-000 iscsi_group_0
             iqn.1986-03.com.sun:02:203e13e0-5249-6ad3-e7d0-e73416edd593
group-001 iscsi_group_1
             iqn.1986-03.com.sun:02:518112d3-dfe2-62a4-ce9d-ea560c39c39c

group-002 iscsi_group_2
             iqn.1986-03.com.sun:02:0bec0881-6b7f-6af7-da7c-9dae2a55903a
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

group-003 iscsi_group_3
             iqn.1986-03.com.sun:02:abb112f4-b45b-66cb-9c8c-def84f3f498a
group-004 iscsi_group_4
             iqn.1986-03.com.sun:02:613d38c5-7304-c9e9-f5dd-b6969ee35e41
group-005 iscsi_group_5
             iqn.1986-03.com.sun:02:c7841126-6a60-ec6e-bf95-b5394e7bf55c
group-006 iscsi_group_6
             iqn.1986-03.com.sun:02:6a00d402-c735-40f9-ae3e-d482ef0d3721
group-007 iscsi_group_8
             iqn.1986-03.com.sun:02:41d29337-1d86-6d37-b34e-ac8f6eb91127

Cause

This is an effect caused by another bug from the iSCSI layer.

RPE confirmed from the following bug: Bug 19877264 - Initiator group removed from one node in cluster

That it is due to the following bug: Bug 19422284 - nas_iscsit_listTargetPortalGroups can deadlock with cluster peer

Solution

Engage Oracle Support via a Service Request to sync up the iSCSI group without rebooting - or alternatively reboot the NAS head.

Upgrade to Appliance Firmware Release 2013.1.5.0 or later.

Restart akd on the node with the missing iSCSI group to allow it to sync up again.

If both nodes have missing iSCSI group, then restart akd one by one.

References

<BUG:19877264> - INITIATOR GROUP REMOVED FROM ONE NODE IN CLUSTER

Attachments

This solution has no attachment