Sun Storage 7000 Unified Storage System: AKD failed to insert uuid

Asset ID:	1-72-1583683.1
Update Date:	2017-10-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1583683.1 : Sun Storage 7000 Unified Storage System: AKD failed to insert uuid - object already exists

Applies to:

Sun Storage 7110 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Sun Storage 7210 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7320 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7420 - Version All Versions to All Versions [Release All Releases]
Sun Storage 7310 Unified Storage System - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)

Symptoms

System may hit some of the following symptoms :

BUI/CLI does not work.
Unable to login to management interface.
Appliance does not comes up after firmware upgrade.
Appliance does not comes up after reboot.

Sun7110 console login: root
Password:
Last login: Sat Sep 7 01:42:05 on console

aksh-wrapper: FATAL: The appliance kit service requires service intervention
Dropping into failsafe shell ...

If you login to SP/ILOM command line interface and confirm the chassis number :

-> show /SYS

/SYS
<.....>
    Properties:
type = Host System
chassis_name = SUN FIRE X4240
chassis_part_number = 540-7618-XX
chassis_serial_number = 0000000-0000000000                <<<<<<<<
chassis_manufacturer = SUN MICROSYSTEMS
product_name = SUN FIRE X4240
product_part_number = 000-0000-00                 <<<<<<<<
product_serial_number = 0000000000                <<<<<<<<
product_version = (none)
product_manufacturer = SUN MICROSYSTEMS
power_state = On

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance Community

Cause

The cause of this issue might be because the serial number of the chassis (CSN) has 'disappeared' and is set to 00000000

Sun7110# svcs -x
svc:/appliance/kit/akd:default (Fishworks Appliance Server)
State: maintenance since Fri Sep 06 22:57:10 2013
Reason: Start method failed repeatedly, last exited with status 1.
   See: http://sun.com/msg/SMF-8000-KS
   See: akd(1M)
   See: /var/svc/log/appliance-kit-akd:default.log
Impact: 15 dependent services are not running. (Use -v for list.)

Sun7110# aklog akd
Thu Sep 5 04:41:10 2013: error getting sp uptime: service processor not responding
Thu Sep 5 16:41:40 2013: error getting sp uptime: service processor not responding
Fri Sep 6 04:41:41 2013: error getting sp uptime: service processor not responding
<...>

AKD service logs:

Sun7110# tail -100 /var/svc/log/appliance-kit-akd:default.log
[ Sep 6 22:56:09 Executing start method ("exec /usr/lib/ak/akd"). ]
akd: failed to start appliance kit: failed to insert uuid unknown-2: object already exists
[ Sep 6 22:57:10 Method "start" exited with status 1. ]
[ Sep 7 04:20:55 Leaving maintenance because clear requested. ]
[ Sep 7 04:20:55 Enabled. ]
[ Sep 7 04:20:55 Executing start method ("exec /usr/lib/ak/akd"). ]
akd: failed to start appliance kit: failed to insert uuid unknown-2: object already exists
[ Sep 7 04:21:55 Method "start" exited with status 1. ]

Sun7110# cd /var/ak/stash/com/sun/ak/xmlrpc/disk
Sun7110# ls
0938QAE002-10 0938QAE002-2   0938QAE002-8   unknown-14     unknown-6
0938QAE002-11 0938QAE002-3   0938QAE002-9   unknown-15     unknown-7
0938QAE002-12 0938QAE002-4   unknown-10     unknown-2      unknown-8
0938QAE002-13 0938QAE002-5   unknown-11     unknown-3      unknown-9
0938QAE002-14 0938QAE002-6   unknown-12     unknown-4
0938QAE002-15 0938QAE002-7   unknown-13     unknown-5

Sun7110# smbios
<....>

Manufacturer: Sun Microsystems
Product: Sun Fire X4240
Version:
Serial Number: 0000000000

UUID: 080020ff-ffff-ffff-ffff-f6873d282100
Wake-Up Event: 0x6 (power switch)
SKU Number: 000-0000-00
Family: Sun Fire X86 Server

ID    SIZE TYPE
3     99   SMB_TYPE_CHASSIS (system enclosure or chassis)

Manufacturer: Sun Microsystems
Version: N/A
Serial Number: 0000000-0000000000                <<<<<<<<
Asset Tag:

Solution

It is recommended to reset SP once as mentioned below after logging into SP/ILOM :
--> reset /SP

And then check the serial number and check whether BUI/CLI are accessible.
--> show /SYS

If the problem is still not resolved it is recommended to engage Oracle Technical Support.

TSE only :

You can follow the relevant internal links below to set the Chassis Serial Number (CSN).

You can get the old chassis serial number from old bundle or the SR header.

https://stbeehive.oracle.com/teamcollab/wiki/AmberRoadSupport:Fred+Payet+-+7x10+MB+Replacement+Procedure

https://stbeehive.oracle.com/teamcollab/wiki/AmberRoadSupport:Fred+Payet+-+7x20+MB+Replacement+Procedure

References

<BUG:15662421> - SUNBT6976771-AK DISK WITH 'UNKNOWN-0' STASH IDENTIFER PREVENTS AKD FROM STARTING
<NOTE:1391828.1> - Sun Storage 7000 Unified Storage System: How to Replace a 7x10 Appliance System Board
<NOTE:1019887.1> - Sun Storage 7000 Unified Storage System: How to Collect a Support Bundle using the BUI or CLI
<NOTE:2021771.1> - Oracle ZFS Storage Appliance: Software Updates

Attachments

This solution has no attachment