Oracle ZFS Storage Appliance: NDMP Backup Path Failed "contained in a pool that is unusable by this NDMP Server"

Asset ID:	1-72-2094814.1
Update Date:	2018-01-05
Keywords:

Solution Type Problem Resolution Sure

Solution 2094814.1 : Oracle ZFS Storage Appliance: NDMP Backup Path Failed "contained in a pool that is unusable by this NDMP Server"

Applies to:

Sun Storage 7410 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-2 - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7420 - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-BA - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7320 - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)

Symptoms

NDMP Backup Path Failed "contained in a pool that is unusable by this NDMP Server"

Changes

Issue has been seen after taking system configuration backup

Cause

The configuration backup process clears the NDMP SMF property elig-resources/zpools

Related bug is

Bug 21219986 - ndmp backup failure after config backups is run

Solution

Upgrade firmware code to OS8.6.2 or above.

As a workaround: Restart AKD through the CLI (maintenance system restart) or via the BUI.

debug.sys shows

May 29 09:05:42 zfs7120-dmz /usr/lib/ndmp/ndmpd[1103]: [ID 828132 daemon.error] [16] /export/ftp/7120_config_backup is contained in a pool that is unusable by this NDMP server
May 29 09:05:42 zfs7120-dmz /usr/lib/ndmp/ndmpd[1103]: [ID 828132 daemon.error] [16] err: 9
May 29 09:05:43 zfs7120-dmz /usr/lib/ndmp/ndmpd[1103]: [ID 828132 daemon.error] [17] pool0/local/Backup/strax is contained in a pool that is unusable by this NDMP server

ndmplog shows backup failed (happen on both tar and zfs type backup).

Prior to that, we see door request to remove zpools and all backup failed after that.

2015-05-28T16:30:12+0000 [0] Received door request to update local resource database
2015-05-28T16:30:12+0000 [0] Remove zpools: 'pool0'
2015-05-29T09:05:42+0000 [16] -------- backup initiated --------
2015-05-29T09:05:42+0000 [16] env(TYPE): "TAR"
2015-05-29T09:05:42+0000 [16] env(FILESYSTEM): "/export/ftp/7120_config_backup"
2015-05-29T09:05:42+0000 [16] env(PREFIX): "/export/ftp/7120_config_backup"
2015-05-29T09:05:42+0000 [16] env(LEVEL): "0"
2015-05-29T09:05:42+0000 [16] env(HIST): "y"
2015-05-29T09:05:42+0000 [16] env(UPDATE): "y"
2015-05-29T09:05:42+0000 [16] mode(NDMP V4)
2015-05-29T09:05:42+0000 [16] *** E R R O R *** [ndmp_backup_get_params_v3:3273]:/export/ftp/7120_config_backup is contained in a pool that is unusable by this NDMP server <<---
2015-05-29T09:05:42+0000 [16] *** E R R O R *** [ndmpd_tar_start_backup_v3:1397]:err: 9
2015-05-29T09:05:42+0000 [16] TYPE: tar

Audit log shows activity that may invoke the door request.

In this case a workflow that run configuration backup.

Thu May 28 16:30:00 2015
nvlist version: 0
        host = <system>
        user = <system>
        class = audit.ak.xmlrpc.workflow.scheduled_start
        payload = (embedded nvlist)
        nvlist version: 0
                name = DEWNR - Configuration Backup
        (end payload)

This workflow invokes the system configuration backup

run("maintenance system configs backup");

References

<NOTE:1387930.1> - Sun Storage 7000 Unified Storage System: How to Troubleshoot NDMP Issues
<BUG:21219986> - NDMP BACKUP FAILURE AFTER CONFIG BACKUPS IS RUN
<NOTE:2165712.1> - All ZFS Storage Appliance (ZFSSA) Software Network Data Management Protocol (NDMP) Backups Will Fail After a Configuration Backup Has Been Initiated

Attachments

This solution has no attachment