Sun Storage 7000 Unified Storage System: High CPU Usage on an 'idle' system - cause is a 'runaway' ndmpd (NDMP daemon) process

Asset ID:	1-72-1616663.1
Update Date:	2016-02-08
Keywords:

Solution Type Problem Resolution Sure

Solution 1616663.1 : Sun Storage 7000 Unified Storage System: High CPU Usage on an 'idle' system - cause is a 'runaway' ndmpd (NDMP daemon) process

Related Items


Sun ZFS Storage 7420
 Sun Storage 7110 Unified Storage System
 Oracle ZFS Storage ZS3-2
 Sun Storage 7210 Unified Storage System
 Oracle ZFS Storage ZS4-4
 Sun Storage 7410 Unified Storage System
 Sun Storage 7310 Unified Storage System
 Sun ZFS Storage 7120
 Oracle ZFS Storage ZS3-4
 Sun ZFS Storage 7320
 Oracle ZFS Storage Appliance Racked System ZS4-4
 Oracle ZFS Storage ZS3-BA

Related Categories


PLA-Support>Sun Systems>DISK>ZFS Storage>SN-DK: 7xxx NAS

Analytics show a high level of CPU usage on system otherwise thought to be effectively idle.
This is a simple procedure to check for a runaway process. 
Processes other than ndmpd can suffer same issues, this is just a case in point for ndmpd.
Different actions may be necessary depending upon the actual process involved.

In this Document

Symptoms

Changes

Cause

Solution

References

Created from <SR 3-8408858361>

Applies to:

Sun Storage 7310 Unified Storage System - Version All Versions and later
Sun Storage 7410 Unified Storage System - Version All Versions and later
Sun Storage 7210 Unified Storage System - Version All Versions and later
Sun Storage 7110 Unified Storage System - Version All Versions and later
Sun ZFS Storage 7420 - Version All Versions and later
7000 Appliance OS (Fishworks)
Observed in os_version: 'ak/generic@2011.04.24.5.0,1-1.33',

Symptoms

CPU usage on the appliance hovering at around 80% - when theoretically the system is idle.

Changes

No changes known

Cause

Check for possible processes that have become 'rogue':

CLI:> confirm shell prstat

PID USERNAME SIZE RSS STATE PRI NICE TIME CPU PROCESS/NLWP
1744 root 201M 189M cpu0 31 0 1975:54:0 33% ndmpd/14

In this instance ndmpd appears to be consuming more CPU that it should for a system with no backups scheduled to be running:

Solution

In this particular instance, a restart of the ndmp service proved effective.

If there are no backup jobs supposed to be currently running, then you should be able to do this:

CLI:> configuration services ndmp disable

followed by

CLI:>configuration services ndmp enable

The ndmpd process was seen to restart with a much lower amount of CPU resource consumed.

References

<NOTE:1395374.1> - Sun Storage 7000 Unified Storage System: Troubleshooting NDMP issues on the ZFS Storage Appliance
<NOTE:1575933.1> - Sun Storage 7000 Unified Storage System: Zombie NDMP process

Attachments

This solution has no attachment