Sun Storage 7000 Unified Storage System: EAK_PEER_AUTH error during Replication between Cluster Peers

Asset ID:	1-72-1548131.1
Update Date:	2018-01-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1548131.1 : Sun Storage 7000 Unified Storage System: EAK_PEER_AUTH error during Replication between Cluster Peers

Applies to:

Sun ZFS Storage 7420 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7120 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7320 - Version All Versions to All Versions [Release All Releases]
Sun Storage 7310 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Sun Storage 7210 Unified Storage System - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)

Symptoms

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance

Replication failed with:

An unanticipated system error occurred:

EAK_PEER_AUTH

This may be due to transient failure, or a software defect. If this problem persists, contact your service provider.

Detail of the error:

Appliance Type: Sun ZFS Storage 7420
Appliance Version: 2011.04.24.5.0,1-1.33
Browser Name: Netscape 5.0 (Windows)
Browser Details: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:10.0.11) Gecko/20100101 Firefox/10.0.11

Exception type: coXmlrpcFault
Native message: EAK_PEER_AUTH
Mapped file: https://10.187.70.200:215/lib/crazyolait/coError.js line 37
Mapped stack trace:

Native file: https://10.187.70.200:215/lib/crazyolait/index.js line 370
Native stack trace:https://10.187.70.200:215/lib/crazyolait/index.js:370

Additional native members:
    faultCode: 125
    faultString: EAK_PEER_AUTH
    coStack: coXmlrpcProxy.unmarshallDoc(doc:<object> "[object XMLDocument]", xml:"<methodResponse><fault>
<value><struct><member>
<name>faultCode</name>
<value><int>125</int></value>
</member>
<member>
<name>faultString</name>
<value><string>EAK_PEER_AUTH</string></value>
</member>
</struct></value>
</fault></methodResponse>
")
coXmlrpcProxy.unmarshallResponse(response:<object> "[object Object]")
<anonymous>(response:<object> "[object Object]", null)
<anonymous>(r:<object> "[object Object]", e:null, cb:<function> "function (response) {\n    var result = null;\n    var fault = null;\n    var docb = true;\n    try {\n        result = coXmlrpcProxy.unmarshallResponse(response);\n        if (result === null) {\n            return;\n        }\n    } catch (e) {\n        try {\n            e.xmlrpc_method = method;\n        } catch (e1) {\n        }\n        if (e instanceof coXmlrpcFault) {\n            fault = e;\n            proxy._fillFault(fault);\n        } else if (proxy._coxp_onasyncerr) {\n            fault = proxy._coxp_onasyncerr(e, null, method, stack, true, retries);\n        } else if (e instanceof coError) {\n            throw e;\n        } else {\n            throw new coError("Response unmarshalling failed", e, stack);\n        }\n    } finally {\n        response = null;\n    }\n    try {\n        if (fault && proxy._coxp_onfault) {\n            docb = proxy._coxp_onfault(method, args, fault, stack);\n        }\n        if (docb) {\n            callback(result, fault);\n        }\n    } catch (e) {\n        try {\n            e.xmlrpc_method = method;\n        } catch (e1) {\n        }\n        if (proxy._coxp_onacberr) {\n            proxy._coxp_onacberr(e, fault, method, stack);\n        } else if (e instanceof coError) {\n            throw e;\n        } else {\n            throw new coError("Unhandled error during callback", e, stack);\n        }\n    } finally {\n        callback = null;\n        stack = null;\n        args = null;\n    }\n}")
<anonymous>()
<anonymous>(<object> "[object Event]")

    xmlrpc_method: nas.listTargetPools
    faultName: EAK_PEER_FATAL

Changes

Project replication is successful but unable to reverse replication.

Activities:

On Head1, create replication target to Head1 and Head2

On Head2, reverse replication from project that has been replicated earlier - We hit EAK_PEER_AUTH

Cause

Head1 failed to authenticate Head2 request for replication.

Alert log does not provide additional information.

On Head2, aksnoop display EAK_PEER_AUTH failed during nas.createTargetPackage.

Replication logs on both target and source do not provide much information.

# aksnoop -C
1.137 => nas.createTargetPackage("7076aeeb-a4dd-ee86-ebac-dd32003f6ef1", {name: "pool2"})
1.155 => log.size("alert")
1.155 <= log.size: 353
1.373 => nas.getProperties({pool: "pool2", project: "test-clone", collection: "local"})
1.374 <= nas.getProperties: {aclinherit: "restricted", aclinherit_source: "default", aclmode: "discard", aclm
ode_source: "default", atime: true, atime_source: "default", checksum: "fletcher4", checksum_source: "inherit
ed", compression: "off", compression_source: "default", dedup_source: "default", dedup: false, compressratio:
100.000000, copies: "1", copies_source: "default", creation: 20130416T05:52:05, guid: "aa71a11f-7032-a9e6-00
00-000000000000", logbias: "latency", logbias_source: "default", mountpoint: "/export", mountpoint_source: "l
ocal", "com.sun.ak:quota": 0.000000, "com.sun.ak:quota_source": "local", readonly: false, readonly_source: "d
efault", recordsize: 131072.000000, recordsize_source: "default", "com.sun.ak:reservation": 0.000000, "com.su
n.ak:reservation_source": "local", rstchown: true, rstchown_source: "default", secondarycache: "all", seconda
rycache_source: "default", nbmand: false, nbmand_source: "default", sharesmb: "off", sharesmb_source: "local"
, sharenfs: "on", sharenfs_source: "local", snapdir: "hidden", snapdir_source: "default", vscan: false, vscan
_source: "default", "com.sun.ak:sharedav": "", "com.sun.ak:sharedav_source": "local", "com.sun.ak:shareftp": "", "com.sun.ak:shareftp_source": "local", "com.sun.ak:sharesftp": "", "com.sun.ak:sharesftp_source": "local", "com.sun.ak:sharetftp": "", "com.sun.ak:sharetftp_source": "local", "com.sun.ak:pool": "pool2", "com.sun.ak:collection": "local", "com.sun.ak:project": "test-clone", "com.sun.ak:origin": {pool: "pool2", collection: "nas-rr-5ccfeacf-28ea-6d1f-94da-d5805abdc715", project: "test", snapshot: ".rr-5ccfeacf-28ea-6d1f-94da-d5805abdc715-1"}, "com.sun.ak:type": "project", "com.sun.ak:canonical_name": "pool2/local/test-clone", "com.sun.ak:default_group": "other", "com.sun.ak:default_group_source": "local", "com.sun.ak:default_permissions_source": "local", "com.sun.ak:default_permissions": "700", ...}
1.418 <= nas.createTargetPackage failed (error 125): "EAK_PEER_AUTH"

A better solution could be provided as part of

Bug 16406392 Replicating from target to source (on same cluster) failed with EAK_PEER_AUTH

Solution

Recreate replication targets on the source replication cluster head.

In this case, recreate replication target to Head1 from Head2.

On Head2 BUI:

Configuration > Services > Replication > Select references to target Head1 and remove

Select (+)Targets to add Head1 as replication target and restart project replication from Head2.

Bug 15521899 - SUNBT6770212-AK-8 replication from a cluster fails in some cluster states

Note: When configuring replication between cluster peers, configure replication with both controllers in the CLUSTERED state

References

<BUG:16406392> - REPLICATING FROM TARGET TO SOURCE FAILED WITH EAK_PEER_AUTH

Attachments

This solution has no attachment