Sun Storage 7000 Unified Storage System: BUI/CLI hang due to analytics compilation (CCP) bug

Asset ID:	1-72-1468128.1
Update Date:	2018-05-24
Keywords:

Solution Type Problem Resolution Sure

Solution 1468128.1 : Sun Storage 7000 Unified Storage System: BUI/CLI hang due to analytics compilation (CCP) bug

Applies to:

Sun ZFS Storage 7320 - Version All Versions and later
Sun ZFS Storage 7420 - Version All Versions and later
Sun Storage 7110 Unified Storage System - Version All Versions and later
Sun Storage 7210 Unified Storage System - Version All Versions and later
Sun Storage 7310 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)

Symptoms

Symptoms observable by the customer:

System does not boot/start

Cannot login to BUI/CLI

Cluster peer CLI command "configuration cluster show" does not return

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance Community

Symptoms observable by the Oracle Support engineer:

Looks like AKD has been trying to stop for over an hour:

nas01# aklog akd | tail
Fri Jan 27 15:01:19 2012: rx_join: waiting on rejoin
Fri Jan 27 15:01:20 2012: initial cluster state AKCS_CLUSTERED
Fri Jan 27 15:01:20 2012: rx_join: done, state is AKCS_CLUSTERED
Fri Jan 27 15:01:20 2012: disconnecting from +cio by request
Fri Jan 27 15:01:20 2012: CIO: channel 1 reset by cio disable
Fri Jan 27 15:01:20 2012: CIO disabled: EAK_MUSTEXIT
Fri Jan 27 15:01:20 2012: ak_ssl_recv() failed with unexpected peer error: SSL read i/o system call error (CIO connection reset by peer)
Fri Jan 27 15:01:20 2012: disconnecting peer +cio
Fri Jan 27 15:01:20 2012: disconnecting peer 127.0.0.1:48586
Fri Jan 27 15:01:49 2012: job c497f1d6-7904-6191-d288-876c3d07a24d failed with exit status 1

nas01# date
Fri Jan 27 16:01:38 UTC 2012

/var/ak/core directory contains a 'core.cpp.xxx' file

Cause

This is a known issue due to an analytics compilation failure.

Known issue - <BUG 15689719> - CPP exits with a segfault

Solution

Recommended action for the customer:

Upgrade to the latest Appliance Firmware 2013.1.x Release.

For Sun Storage 7000 Unified Storage System hardware (that does not support the Appliance Firmware 2013.1.x Release), you will need to engage Oracle Support, by opening a Service Request, so that Oracle Support Services can provide confirmation of this issue and then carry out the appropriate activities to resolve the issue.

Recommended actions for the Oracle Support engineer:

Remove the analytics from the appliance stash - see the following wiki document:

https://stbeehive.oracle.com/teamcollab/wiki/AmberRoadSupport:Solaris+shell+procedure+to+remove+%28excessive%29+analytics

If you cannot access this document engage NAS Storage-TSC for assistance

Back to <Document 1401282.1> Sun Storage 7000 Unified Storage System: How to Troubleshoot Unresponsive Adminstrative Interface (BUI/CLI Hang).

***Checked for relevance on 24-MAY-2018***

References

<BUG:15689719> - SUNBT7010064 CPP EXITS WITH A SEGFAULT CAUSING AKD TO EXIT
SUPPORT WIKI - REMOVE EXCESS ANALYTICS: HTTPS://STBEEHIVE.ORACLE.COM/TEAMCOLLAB/WIKI/AMBERROADSUPPORT:SOLARIS+SHELL+PROCEDURE+TO+REMOVE+%28EXCESSIVE%29+ANALYTICS
<NOTE:1401282.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot Unresponsive Administrative Interface (BUI/CLI hang)

Attachments

This solution has no attachment