Sun Storage 7000 Unified Storage System: Zombie NDMP process

Asset ID:	1-72-1575933.1
Update Date:	2018-01-08
Keywords:

Solution Type Problem Resolution Sure

Solution 1575933.1 : Sun Storage 7000 Unified Storage System: Zombie NDMP process

Applies to:

Sun ZFS Storage 7120 - Version All Versions and later
Sun Storage 7110 Unified Storage System - Version All Versions and later
Sun ZFS Storage 7420 - Version All Versions and later
Sun ZFS Storage 7320 - Version All Versions and later
Sun Storage 7410 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)

Symptoms

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance Community

Zombie NDMP threads.

Cause

Zombie threads created during NDMP ZFS restore.

See Bug 15697220 - SUNBT7019787 Ndmpd zfs restore creates zombie thread

Capture a ndmpd core from the OS shell:

# gcore -o /var/ak/dropbox/ndmpd.gcore `pgrep ndmpd`

Check status of NDMP processes with prstat and pstack:

# prstat -Lp `pgrep ndmpd`
PID USERNAME SIZE RSS STATE PRI NICE TIME CPU PROCESS/LWPID
26306 root 81M 70M cpu7 10 0 486:20:51 7.0% ndmpd/95
26306 root 81M 70M zombie 0 - 0:00:00 0.0% ndmpd/113
26306 root 81M 70M zombie 0 - 0:00:00 0.0% ndmpd/101
26306 root 81M 70M zombie 0 - 0:00:00 0.0% ndmpd/118
26306 root 81M 70M zombie 0 - 0:00:00 0.0% ndmpd/163

pstack `pgrep ndmpd`

----------------- lwp# 17 --------------------------------
** zombie (exited, not detached, not yet joined) **
----------------- lwp# 28 --------------------------------
feed04b7 nanosleep (fc18c600, fc18c608)
feebc369 sleep (1, 812798c, 80cf2f4, 8096246) + 31
0809627e ndmp_stop_reader_thread (fc18c910, fc18c68c, fc18c660, 0) + 7e
08093715 ndmpd_tar_backup_abort_v3 (8b43608, 81279ac, 812798c, 1000001) + 31
08073561 ndmpd_data_abort_v3 (8b19488) + 91
0806e253 ndmp_process_messages (8b19488, 0, fc18c728, fee7baba) + 107
----------------- lwp# 32 --------------------------------
** zombie (exited, not detached, not yet joined) **

Solution

Update ZFS storage appliance firmware to 2011.1.1.0 to prevent further occurrences.

In the interim, restart the NDMP service through BUI.

References

<NOTE:1387930.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot NDMP Issues
<NOTE:1395374.1> - Sun Storage 7000 Unified Storage System: Troubleshooting NDMP issues on the ZFS Storage Appliance

Attachments

This solution has no attachment