ODA: OAKERR:5003 Command 'oakcli show repo' Does Not Show Shared Repository

Asset ID:	1-72-2057349.1
Update Date:	2015-10-23
Keywords:

Solution Type Problem Resolution Sure

Solution 2057349.1 : ODA: OAKERR:5003 Command 'oakcli show repo' Does Not Show Shared Repository

Applies to:

Oracle Database Appliance X5-2 - Version All Versions to All Versions [Release All Releases]
Information in this document applies to any platform.

Symptoms

When running the following command in ODA_BASE:

oakcli show repo

... only the local repo is listed, but the shared repo is not shown.

When attempting to start the share repo, it fails and all the VMs resident in this shared repo also do not start.

Reviewing the ODA_BASE /opt/oracle/oak/log/$HOMENAME/odabaseagent/odabaseagent.log, the following OAKERR:5003 error is generated:

2015-09-11 18:49:44,937 [SYS_DISC_1405881454_SharedRepoType] [Thread-10239] [odabaseutils] [DEBUG] [46] Created xml string <oakvmres><OakMessages><OakMessage><id>0</id><text>OAKERR:5003 Command execution unsuccessful for Command=su - grid -c "export ORACLE_SID=+ASM1; export ORACLE_HOME=/u01/app/12.1.0.2/grid; /u01/app/12.1.0.2/grid/bin/asmcmd --nocp volinfo --all | grep -w -i -A 3 'acfsvol' | grep 'Size'" Error=</text></OakMessage></OakMessages></oakvmres>

Changes

Recently a general ACFS Volume 'acfsvol' was manually deleted.

Cause

When attempting to delete an unused ACFS volume, you can do this in ASM using asmcmd command. However that will not cleanup the entries in ACFS registry.

So oakcli commands will still try to find out the related volume information from asmcmd, which will then fail with OAKERR:5003 in the log.

Solution

Resolve this issue by deleting the related entries in the ACFS registry:

/sbin/acfsutil registry -d /dev/asm/acfsvol-486

The volumes output of the command "acfsutil registry -l" should match the output of "asmcmd volinfo", otherwise you will hit this problem.

References

<BUG:21757121> - CAN NOT FIND SHAREDREPO AFTER ODA BASE REBOOT
<BUG:21046486> - LNX64-112-CMT:FAILED TO CREATE REPO DUE TO VOLUME NAME HAS EXISTED
<BUG:18769746> - SHARED REPOSITORY WAS NOT AVAILABLE AFTER APPLYING PATCH 18284007
<BUG:21183688> - UNABLE TO RESTART SHARED REPO
<NOTE:2037999.1> - Troubleshooting ACFS Repository/VM Mounting Issues on Oracle Database Appliance
<NOTE:1929576.1> - ODA ODAVP Created Shared Repositories with VM Clones are Missing / Gone on both DOM0 DOM1 Nodes in /OVS on 2.10 using non-lowercase Node Names
<NOTE:1605662.1> - ODA: "oakcli show repo" Does Not Show Any Repository After Restart
<NOTE:166650.1> - Working Effectively With Oracle Support - Best Practices

Attachments

This solution has no attachment