Sun Storage 7000 Unified Storage System: Alert "Peer_description = Unknown (disconnected Or Restarting)" - BUI/CLI inaccessible, support bundle collection in progress

Asset ID:	1-72-1601980.1
Update Date:	2016-09-30
Keywords:

Solution Type Problem Resolution Sure

Solution 1601980.1 : Sun Storage 7000 Unified Storage System: Alert "Peer_description = Unknown (disconnected Or Restarting)" - BUI/CLI inaccessible, support bundle collection in progress

Applies to:

Sun ZFS Storage 7320 - Version All Versions and later
Sun ZFS Storage 7420 - Version All Versions and later
Sun ZFS Storage 7120 - Version All Versions and later
Sun Storage 7210 Unified Storage System - Version All Versions and later
Sun Storage 7310 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)
The user had initiated a support bundle upload to send a system core file in to Oracle for analysis just prior to the problem.

Symptoms

BUI and CLI are inaccessible.

The following alert was reported:

peer_description = Unknown (disconnected or restarting)

Cluster reliability is impaired. If the cluster peer is functioning normally but no cluster interconnects remain active, arbitrary and unwanted cluster takeover may occur.

REC-ACTION: Check the cluster interconnect cables and the state of the cluster peer. Contact your vendor for support if an interconnect link remains inexplicably down.

Changes

Creation of a support bundle containing a very large system core file.

Cause

The akd service was not running.

There is a 60G core file in /var/ak/cores that was being copied into a support bundle by the system for upload.

A check of disk space available showed 103G.

That's not enough to create and 'tar' the support bundle, as there are temporarily 3 times the space of a core file required.

The system temporarily ran out of disk space in the system pool.

Solution

Recommended action for the customer:

You will need to engage Oracle Support, by opening a Service Request, so that Oracle Support Services can provide confirmation of this issue and then carry out the appropriate activities to resolve the issue.

svcs -xv returned "svcs: Could not bind to repository server: repository server unavailable. Exiting."

Confirmed there was no longer a space issue on the system disk.

Given the svcs problem, restarted startd with kill -1 `pgrep startd`

akd restarted and all services returned.

References

<BUG:16263417> - CREATING NEW DATASET FOR DROPBOX DIR TO PREVENT SYSTEM POOL SPACE EXHAUSTION

Attachments

This solution has no attachment