Sun Microsystems, Inc.  Oracle System Handbook - ISO 7.0 May 2018 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-2362045.1
Update Date:2018-02-27
Keywords:

Solution Type  Technical Instruction Sure

Solution  2362045.1 :   Diameter Signaling Router (DSR): Accept Upgrade Status Shows Failed On MP's of type Gen-8 Blades  


Related Items
  • Oracle Communications Diameter Signaling Router (DSR)
  •  
Related Categories
  • PLA-Support>Sun Systems>CommsGBU>Global Signaling Solutions>SN-SND: Tekelec DSR
  •  




In this Document
Goal
Solution


Created from <SR 3-16844296141>

Applies to:

Oracle Communications Diameter Signaling Router (DSR) - Version DSR 7.2.0 and later
Tekelec

Goal

After Accept Upgrade action the Upgrade State says failed with reason <Upgrade has exceeded 60 minutes during reboot. Monitoring has timed out. Server status is unknown. Server may still be rebooting. See upgrade log for status.> in Active NOAM GUI : Main Menu: Administration -> Software Management -> Upgrade

Solution

First of all verify that the "ACCEPT UPGRADE" Action has been completed successfully or not..

  1. You can observe that after "ACCEPT UPGRADE" the Alarm 32532 (Server Upgrade Pending Accept/Reject) will be cleared from NOAM GUI => It confirms ACCEPT UPGRADE Completed successfully.
  2. You can also verify the "upgrade.log" from the MP on which the "ACCEPT UPGRADE" State shows FAILED in GUI => We can  see that ACCEPT task started and then mark it to be finished.

[root@MP filemgmt]# tail -f /var/TKLC/log/upgrade/upgrade.log
1516323768:: /etc/rc4.d/S99TKLCupgradeStatus - AlarmMgr daemon is not running, delaying by 1 minute
1516323781:: /etc/rc4.d/S99TKLCupgradeStatus - setting 'Upgrade Accept/Reject' alarm
1516323782:: /etc/rc4.d/S99TKLCupgradeStatus -
1518380549::Accept TPD_TASK_ID is 1518380547.0
1518380551::Called with options: --accept
1518380552::Loading Backout::BackoutType::RPM
1518380552::Accepting Upgrade
1518380552::Executing common accept tasks
1518380552::Setting POST_UPGRADE_ACTION to ACCEPT in upgrade info.
1518380552::Cleaning backout directory.
.
.
.
1518380559::Marking task 1518380547.0 as finished.
1518380559::

Once we verified and confirmed that the "ACCEPT UPGRADE" was successful and the Upgrade State marked as "FAILED" at NOAM GUI, is seems to be stuck . So, We have to perform the workaround to clear the stuck Upgrade Status for those MP's Gen8 Blades.

Note : Please contact Oracle TAC support to fix the issue.

Perform the following workaround to clear the stuck upgrade status :

  • Login to Active NOAM CLI as root user.
  • Check the output of Upgrade Status table using : iqt -pE UpgradeStatus ( You should be seeing the output for MP Servers whose status was marked as FAILED)
  • Edit the UpgradeStatus table using : vi UpgradeStatus
  • Remove those entries for the failed status : use "dd"
  • Save the file using ":wq!"
  • Check the output of Upgrade Status table again using : iqt -pE UpgradeStatus ( You should not see anything now)
  • Verify now from Active NOAM GUI :Main Menu: Administration -> Software Management -> Upgrade
  • For those MP Server whose Upgrade Status was marked as "FAILED" has been changed to "BACKUP NEEDED"

 

 


Attachments
This solution has no attachment
  Copyright © 2018 Oracle, Inc.  All rights reserved.
 Feedback