Sun Storage 7000 Unified Storage System: NDMP

Asset ID:	1-72-1552157.1
Update Date:	2018-03-20
Keywords:

Solution Type Problem Resolution Sure

Solution 1552157.1 : Sun Storage 7000 Unified Storage System: NDMP - Symantec Exec Backup Fails

Applies to:

Sun Storage 7110 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Sun Storage 7210 Unified Storage System - Version All Versions to All Versions [Release All Releases]
Sun ZFS Backup Appliance - Version All Versions to All Versions [Release All Releases]
Sun ZFS Storage 7320 - Version All Versions to All Versions [Release All Releases]
Oracle ZFS Storage ZS3-2 - Version All Versions to All Versions [Release All Releases]
7000 Appliance OS (Fishworks)

Symptoms

To discuss this information further with Oracle experts and industry peers, we encourage you to review, join or start a discussion in the My Oracle Support Community - Disk Storage ZFS Storage Appliance

Backup is aborted and fails on some replicated filesystems. NDMP log reports the following errors:

12/07 19:17:27 env(FILESYSTEM): "/export/replicatedshare"
12/07 19:17:27 env(HIST): "Y"
12/07 19:17:27 env(TYPE): "dump"
12/07 19:17:27 env(UPDATE): "Y"
12/07 19:17:27 env(LEVEL): "0"
12/07 19:17:27 env(HIST): "Y"
12/07 19:17:27 env(EXCLUDE) not defined
12/07 19:17:27 env(FILES) not defined
12/07 19:17:27 backup default env(DIRECT): YES
12/07 19:17:27 env(UPDATE): "Y"
12/07 19:17:30 Local operation: 65536
12/07 19:17:30 Adjusted read size: 524288
12/07 19:17:30 Backing up "/export/replicatedshare" started.
12/07 19:22:07 bksize 22850551564759, 22314991762KB, 21791984MB
12/07 23:45:00 *** E R R O R *** [backup_filev3:1715]:acl_get error
12/07 23:45:17 *** E R R O R *** [backup_dirv3:1642]:acl_get error errno=2
12/07 23:45:17 *** E R R O R *** [tar_backup_v3:2398]:Backup Reader Error: No such file or directory
12/07 23:45:17 Backup was aborted

Configuration is:

1. Backup software used is Symantec Exec Backup

2. System owning 'replicatedshare' which is backed up is:
Appliance Name: zfssa-repl-target
Appliance Type: Sun ZFS Storage 7120
Appliance Version: 2011.04.24.5.0,1-1.33

3. System replicating project to zfssa-repl-target is:
Appliance Name: zfssa-repl-source
Appliance Type: Sun ZFS Storage 7120
Appliance Version: 2011.04.24.5.0,1-1.33

4. 'replicatedshare' is a share on zfssa-repl-target host replicated from zfssa-repl-source as part of a project replication.

Cause

NDMP error message shows that function which gets the error is backup_filev3:

12/07 23:45:00 *** E R R O R *** [backup_filev3:1715]:acl_get error
12/07 23:45:17 *** E R R O R *** [backup_dirv3:1642]:acl_get error errno=2
12/07 23:45:17 *** E R R O R *** [tar_backup_v3:2398]:Backup Reader Error: No such file or directory

Functions hierarchy is:

tar_backup_v3
backup_reader_v3
lbrbk_v3/timebk_v3
backup_dirv3
backup_filev3
acl_get

acl_get is the function checking acls which is returning the error.

/usr/bin/find /export/replicatedshare ! -acl 1> acl-broken.out 2> acl-broken.err

From file acl-broken.out. we see files which don't have acl set:

# more acl-broken.out
/path/file1
/path/file2
#

Which you can check by listing them:

# ls -l /path/
ls: can't read ACL on ./file1: No such file or directory
ls: can't read ACL on ./file2: No such file or directory
---------- 1 2147484314 2147483847 8704 Jan 16 13:30 file1
---------- 1 2147484314 2147483847 8704 Jan 16 13:30 file2
----------+ 1 2147484314 2147483847 191288 Oct 7 2011 file3
----------+ 1 2147484314 2147483847 2642 Oct 7 2011 file4
#

This means that ACL got corrupted by replication.

Solution

This issue is an instance of BUG 15759418 (Spill block can be dropped in some situations during incremental receive) which is fixed in ak-2011.1.5.0 release or above.

In order to fix the failed replication:

Install Appliance Firmware Release 2011.1.5.0 or above
Recreate the failed replication from scratch

References

<BUG:16288546> - SYMANTEC EXEC BACKUP FAILS TO BACKUP SOME REPLICATED FILESYSTEMS
<BUG:15759418> - SUNBT7097870-AK-2011.04.24 SPILL BLOCK CAN BE DROPPED IN SOME SITUATIONS DURING

Attachments

This solution has no attachment