Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-72-2383818.1
Update Date:2018-04-08
Keywords:

Solution Type  Problem Resolution Sure

Solution  2383818.1 :   Diameter Signaling Router (DSR): PSBR Process Restart (Event_ID 31002 and 31003) Causing S-SBR Switch Over  


Related Items
  • Oracle Communications Diameter Signaling Router (DSR)
  •  
Related Categories
  • PLA-Support>Sun Systems>CommsGBU>Global Signaling Solutions>SN-SND: Tekelec DSR
  •  




In this Document
Symptoms
Changes
Cause
Solution
References


Created from <SR 3-13682481291>

Applies to:

Oracle Communications Diameter Signaling Router (DSR) - Version DSR 7.2.0 to DSR 8.1.1 [Release DSR 7.0 to DSR 8.0]
Tekelec

Symptoms

Following alarms are generated on DSR:

TIMESTAMP: 2016-11-18 12:02:23.063 <TZ>

NETWORK_ELEMENT: SOAM_PDRA

SERVER: DRA

SEQ_NUM: 4185

EVENT_NUMBER: 31002

SEVERITY: MINOR

PROCESS: procmgr

TYPE:SW

INSTANCE:PSBR_S_Proc

NAME:Process Watchdog Failure

DESCRIPTION:Process watchdog timed out

ERR_INFO: GN_EXPIRED/WRN Watchdog expired [procmgr.cxx:857]  ^^ threshold:25 seconds, last updated: 11/18/2016 12:01:33.000 [procmgr.cxx:858]  ^^ Sending TERM signal (attempting to get abterm) [procmgr.cxx:889]  ^^ [13413:procmgr.cxx:890]

SECS:1479450743

USECS:63000

CISECS:1479450743

CIUSECS:69000

ID:13169

 

TIMESTAMP: 2016-11-18 12:01:58.236 <TZ>

NETWORK_ELEMENT: SOAM_PDRA

SERVER: DRA

SEQ_NUM: 4184

EVENT_NUMBER: 31003

SEVERITY: MINOR

PROCESS: psbr

TYPE: SW

INSTANCE: PSBR_S_Proc

NAME: Thread Watchdog Failure

DESCRIPTION: Thread watchdog timed out

ERR_INFO: GN_EXPIRED/WRN Thread watchdog expired for thread ID 41756 (taskName=StackTask, stackTaskName=SbrSisSendRarTask) [SigCtl.cxx:194]  ^^ [41435:SigCtl.cxx:197]

SECS: 1479450718

USECS: 236000

CISECS: 1479450718

CIUSECS: 319000

ID: 13833

 


 

On DSR 7.2 system, following abterm are seen:

 

/bin/cat /var/TKLC/rundb/run/proc/psbr/abterm.psbr.17031215493700  

  

307449 Thread 28 (Thread 0x7f63e3e13700 (LWP 35441)):

307450 #0  0x00000039fd4114b0 in __tls_get_addr () from  

/lib64/ld-linux-x86-64.so.2

307451 #1  0x00007f63fb970e4c in ErrDescrStack::getCurErrDescrStack() () from

 

/opt/comcol/prod/lib/libcomcol-g4-6.4.so

307452 #2  0x00007f63fb970ea9 in ErrDescrStack::top() () from  

/opt/comcol/prod/lib/libcomcol-g4-6.4.so

307453 #3  0x00007f63fb970f69 in errId() () from  

/opt/comcol/prod/lib/libcomcol-g4-6.4.so

307454 #4  0x00007f63fbaa6a09 in IdbBaseIter::getNext() () from  

/opt/comcol/prod/lib/libcomcol-g4-6.4.so

307455 #5  0x00007f63fbaa6a36 in IdbBaseIter::getNext() () from  

/opt/comcol/prod/lib/libcomcol-g4-6.4.so

307456 #6  0x00007f63fbab974d in IdbReadIter::getNext(void*) () from  

/opt/comcol/prod/lib/libcomcol-g4-6.4.so

307457 #7  0x00007f63fa3f14ab in  

psbr::PsbrDb::getNextRecord(psbr::PsbrDb::PsbrDbTables, void*) () from  

/usr/TKLC/psbr/lib/libpsbrDb.so

307458 #8  0x00007f63fa70c829 in  

psbr::SbrSisSendRarTask::processPendingReleaseRarTbl(Ttime64&) () from  

/usr/TKLC/psbr/lib/libpsbr.so

307459 #9  0x00007f63fa70fffa in psbr::SbrSisSendRarTask::doPeriodic(bool) ()

 

from /usr/TKLC/psbr/lib/libpsbr.so

307460 #10 0x00007f63fb0421b1 in StackTask::svc() () from  

/usr/TKLC/awpcommon/lib/libstackBase.so

307461 #11 0x00007f63fc172d27 in ACE_Task_Base::svc_run(void*) () from  

/usr/TKLC/ace/6.0.1/ace/libACE.so.6.0.1

307462 #12 0x00007f63fc174305 in ACE_Thread_Adapter::invoke_i() () from  

/usr/TKLC/ace/6.0.1/ace/libACE.so.6.0.1

307463 #13 0x00007f63fc174381 in ACE_Thread_Adapter::invoke() () from  

/usr/TKLC/ace/6.0.1/ace/libACE.so.6.0.1

307464 #14 0x00000039fe007aa1 in start_thread () from /lib64/libpthread.so.0

307465 #15 0x00000039fd8e893d in clone () from /lib64/libc.so.6

 

 

 

 

Changes

 Upgrade from previous release to DSR 7.2.0

Cause

Following bug has been identified as the cause of this issue:

 

Bug 27331058 - S-SBR switchover observed because of psbr watchdog timeout


 

Solution

Upgrade to DSR 8.12
 

References

<NOTE:2161294.1> - Policy Diameter Routing Agent (P-DRA) - Does Not Clears Stale Sessions [Event -22719 - Maximum Number of Sessions Per Binding Exceeded]
<BUG:27331058> - S-SBR SWITCHOVER OBSERVED BECAUSE OF PSBR WATCHDOG TIMEOUT

Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback