Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-72-1623504.1
Update Date:2015-12-15
Keywords:

Solution Type  Problem Resolution Sure

Solution  1623504.1 :   ODAchk hang to finish on remote nodes  


Related Items
  • Oracle Database Appliance
  •  
Related Categories
  • PLA-Support>Eng Systems>Exadata/ODA/SSC>Oracle Database Appliance>DB: ODA_EST
  •  




Created from <SR 3-8544304883>

Applies to:

Oracle Database Appliance - Version All Versions and later
Information in this document applies to any platform.
This document APPLIES ONLY to ODAChk 2.2.3 (ODA / OAK 2.8) and earlier

Symptoms

ODAchk is hanging on "Waiting for odachk to finish on remote nodes".

 

Do you want to continue using older version of odachk? [y/n][y]

CRS stack is running and CRS_HOME is not set. Do you want to set CRS_HOME to
/u01/app/11.2.0.4/grid?[y/n][y]

Checking ssh user equivalency settings on all nodes in cluster

Node rwsoda209db2 is configured for ssh user equivalency for racusr user

Searching for running databases . . . . .

List of running databases registered in OCR
1. odacn
2. None of above

Select databases from list for checking best practices. For multiple
databases, select 1 for All or comma separated number like 1,2 etc [1-2]

[1].

Checking Status of Oracle Software Stack - Clusterware, ASM, RDBMS
. . . . . . . . . . . .
. . . . . . . . . . . . . . . . . . . . . . . . .
------------------------------------------------------------------------------
-------------------------
Oracle Stack Status

------------------------------------------------------------------------------
-------------------------
Host Name CRS Installed ASM HOME RDBMS Installed CRS UP ASM UP
RDBMS UP DB Instance Name
------------------------------------------------------------------------------
-------------------------
rwsoda209db1 Yes Yes Yes Yes Yes
Yes odacn1
rwsoda209db2 Yes Yes Yes Yes Yes
Yes odacn2
------------------------------------------------------------------------------
-------------------------

Copying plug-ins
.
. . . . . . . . . . . . . . . . . . . .
.
. . . . . .
.
.
113 of the included audit checks require root privileged data collection . If
sudo is not configured or the root password is not available, audit

checks which require root privileged data collection can be skipped.

1. Enter 1 if you will enter root password for each host when prompted

2. Enter 2 if you have sudo configured for oracle user to execute
root_odachk.sh script

3. Enter 3 to skip the root privileged collections

4. Enter 4 to exit and work with the SA to configure sudo or to arrange for
root access and run the tool later.

Please indicate your selection from one of the above options for root
access[1-4][1]:- ]]\

Is root password same on all nodes?[y/n][y]

Enter root password :-

Verifying root password.
.
. . .
.
.
*** Checking Best Practice Recommendations (PASS/WARNING/FAIL) ***
.
.
.
Collections and audit checks log file is
/home/racusr/odachk_rwsoda209db1_odacn_012514_001137/log/odachk.log
.
.
.
Checking for prompts in /home/racusr/.bash_profile on rwsoda209db1 for racusr
user...
.
.
.
.
Checking for prompts in /home/racusr/.bash_profile on rwsoda209db2 for racusr
user...
.
.
.
Starting to run odachk in background on rwsoda209db2
.
=============================================================
Node name - rwsoda209db1
=============================================================

Collecting - ASM Diskgroup Attributes
Collecting - ASM initialization parameters
Collecting - Database Parameters for odacn database
Collecting - Database Undocumented Parameters for odacn database
Collecting - RDBMS Feature Usage for odacn database
Collecting - Kernel parameters
Collecting - Maximum number of semaphore sets on system
Collecting - Maximum number of semaphores on system
Collecting - Maximum number of semaphores per semaphore set
Collecting - OS Packages
Collecting - Patches for Grid Infrastructure
Collecting - Patches for RDBMS Home
Collecting - number of semaphore operations per semop system call
Preparing to run root privileged commands rwsoda209db1.

Collecting - CRS user limits configuration
Collecting - Firmware and software versions
Collecting - Network and Bonding Interfaces Status
Collecting - OS Disk Storage Status
Collecting - System Component Status
Collecting - Validate Shared storage

Data collections completed. Checking best practices on rwsoda209db1.
------------------------------------------------------------------------------
--------

FAIL => One or more errors or warnings for system component checks
INFO => Some custom (non-default) RPM are installed
WARNING => One or more warnings for network and bonding interface checks
.
.
Best Practice checking completed.Checking recommended patches on
rwsoda209db1.
------------------------------------------------------------------------------
---

Collecting patch inventory on CRS HOME /u01/app/11.2.0.4/grid
Collecting patch inventory on ORACLE_HOME
/u01/app/oracle/product/11.2.0.4/dbhome_1

Waiting for odachk to finish on remote nodes
..............................................................................
..............................................................................
...............................................................
.
..............................................................................
..............................................................................
...............................................................
.

 

Changes

No change.

/opt/oracle/oak/odachk/bin/oakcli odachk -v
ODACHK VERSION: 2.2.3_20131016

 

Cause

Unpublished Bug 18134167 : LNX64-112-CMT:ODACHK WAS EXPIRED AND HANG TO WAIT FOR THE FINISH ON REMOTE NODES

This is fixed in ODA 2.9 and higher

Solution

To avoid this hang on remote node, you need to disable parallelism by setting an environment variable before oakcli calls odachk like it does for RAT_OUTPUT. So set RAT_COMPUTE_RUNMODE=serial and it will finish without any issue.

Also, It must be run as oracle user so the easier syntax is:

# su - oracle -c "export RAT_COMPUTE_RUNMODE=serial;/opt/oracle/oak/odachk/odachk"

 

References

<BUG:18134167> - LNX64-112-CMT:ODACHK WAS EXPIRED AND HANG TO WAIT FOR THE FINISH ON REMOTE NODES

Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback