Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-72-2181678.1
Update Date:2017-04-07
Keywords:

Solution Type  Problem Resolution Sure

Solution  2181678.1 :   IMF "Apply Changes" Action Reaches its Timeout Without The Changes are Applied and Action Status displays "Pending"  


Related Items
  • Oracle Communications Performance Intelligence Center (PIC) Software
  •  
Related Categories
  • PLA-Support>Sun Systems>CommsGBU>Global Signaling Solutions>SN-SND: Tekelec PIC
  •  


Apply Changes does not complete needed actions. The action reaches its timeout and the status returned after the time out is "Pending", showing that no changes were applied.

In this Document
Symptoms
Cause
Solution


Created from <SR 3-13311014585>

Applies to:

Oracle Communications Performance Intelligence Center (PIC) Software - Version 10.1.5 and later
Information in this document applies to any platform.

Symptoms

The Apply Changes fails on IMF systems.

Cause

In this case check first whether jmx agent is running on the system.

The result should look like this:

[root@IMF-1A ~]# ps -ef | grep jmx
root 7393 7316 0 15:51 pts/0 00:00:00 grep jmx
cfguser 15371 6620 0 Sep09 ? 00:00:00 /bin/sh /opt/TKLCjmxagent/bin/startJmxAgentXmf.sh
cfguser 15372 15371 0 Sep09 ? 00:00:00 /bin/sh /opt/TKLCjmxagent/bin/startJmxAgentXmf.sh
cfguser 15373 15371 0 Sep09 ? 00:00:02 circAdd /tekelec/TKLCmf/runtime/run/proc/jmx_agent.log
cfguser 15410 15372 0 Sep09 ? 00:00:00 /bin/bash /opt/TKLCjmxagent/bin/jmxagent -Dmysql.port=15616 -Dplat.function=IMF -Ddesig=1A
root 15414 15410 0 Sep09 ? 00:00:00 sudo /opt/TKLCjmxagent/bin/jmxagentrun -Dmysql.port=15616 -Dplat.function=IMF -Ddesig=1A
root 15415 15414 0 Sep09 ? 00:13:12 /etc/alternatives/java -Djava.awt.headless=true -Dweblogic.corba.client.bidir=true -Dcom.steleus.jmx.home=/opt/TKLCjmxagent -Dcom.steleus.jmx.log=/var/TKLC/log/jmxagent -Dmysql.port=15616 -Dplat.function=IMF -Ddesig=1A -cp /opt/TKLCjmxagent/jar/com.steleus.jmx.jar com.steleus.jmx.Agent

When the "Apply changes" action is launched, open the jmx_agent.log display in real time to verify whether there are currently actions related to the Apply Changes:

[root@IMF-1A ~]# cf.follow -15 jmx_agent.log | grep –v Sending

(The option -v Sending is to avoid having a huge number of alarm messages displayed.)

If:

  1. JMX agent runs correctly
  2. No message related to the "Apply changes" are displayed in the jmx_agent.log
  3. The "Apply changes" operation reaches the time out

It means that the jmx connection is stuck and unusable for Apply Changes operations management.

 

Another check to be done is to verify the good status of xMF/NSP connection. It is essential to guarantee the operation can be completed correctly.

Below, the command to launch analyze_subsystem (as cfguser) and a correct result. In case of wrong communication with the NSP, this point will have to be identified and fixed.

[cfguser@IMF0101-1A ~]$ analyze_subsystem.sh

-----------------------------------------------------
ANALYSIS OF SERVER IMF0101-1A STARTED
FIPS integrity verification test failed.
-----------------------------------------------------

cfguser@yellow-1b's password: 04:11:24: STARTING HEALTHCHECK PROCEDURE - SYSCHECK=0
04:11:24: date: 04-07-17, hostname: IMF0101-1A
04:11:25: TPD VERSION: 7.0.3.0.0-86.40.0
04:11:25: XMF VERSION: [ 10.2.0.0.0-25.3.0 ]
04:11:25: -------------------------------------------------
04:11:25: Checking disk free space
04:11:26: No disk space issues found
04:11:26: Checking syscheck - this can take a while
04:11:33: No errors in syscheck modules
04:11:33: Checking statefiles
04:11:34: Statefiles do not exist
04:11:34: Checking runlevel
04:11:34: Runlevel is OK (4)
04:11:34: Checking upgrade log
04:11:35: Install logs are free of errors
04:11:35: Analyzing date
04:11:35: NTP deamon is running
04:11:35: IP of NTP server is set
04:11:36: Server is synchronized with ntp server
04:11:36: Analyzing IDB state
04:11:36: IDB in START state
04:11:37: Checking IDB database
04:11:37: iaudit has not found any errors
04:11:37: Analyzing processes
04:11:38: Processes analysis done
04:11:38: Analysing database synchronization
04:11:39: Either Database synchronization in healthy state or errors found are non-blocking
04:11:39: Checking weblogic server entry
04:11:39: Appserver is present
04:11:39: All tests passed. Good job!
04:11:40: ENDING HEALTHCHECK PROCEDURE WITH CODE 0

 

Solution

If the issue comes from jmx side, restarting the jmx agent will release the connection.

Connect on IMF as cfguser and launch:

pm.kill jmx_agent.log

Launch the "Apply changes" from NSP GUI and check jmx_agent log to verify whether operations are managed.

This must be done on all IMF.
 

 

 


Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback