Performance Intelligence Center - Missing Daily Aggregates on MSU Accounting

Asset ID:	1-72-2242521.1
Update Date:	2017-03-24
Keywords:

Solution Type Problem Resolution Sure

Solution 2242521.1 : Performance Intelligence Center - Missing Daily Aggregates on MSU Accounting

Applies to:

Oracle Communications Performance Intelligence Center (PIC) Software - Version 7.5 to 7.5 [Release 7.0]
Information in this document applies to any platform.

Symptoms

The automated report (/User Content/DataAging/Aggregation Monitor reports - Scheduled Daily) showing status of last day data aggregation do not show any line for several sessions since several days.

Cause

Both basic statistics sessions (KPI_XXX sessions) are delayed because of Operate process that manages these data is delayed. The reason is that the IXP server on which these operates are running is overloaded by stuck "iaudit" processes. These processes use a lot CPU resource, preventing the Operate to work fine as no more CPU time is available. This makes that processes SUDRs are delayed more and more.
This delays the basic data management itself (SUDR delayed) and then all derived results.

When "top" command was launched on the system it shows "iaudit" processes using nearly all available CPU. The Operate were not using a lot of CPU time, making them to be more and more delayed to process incoming SUDRs.

Solution

Kill the iaudit processes using too high CPU resources.
Check whether the delay has been resorbed
If there is no more delayed process, reboot the server when possible
It will be necessary to check the iaudit in the next hours/days after reboot to verify whether the process has not multiple instances

Attachments

This solution has no attachment