Sun Storage 7000 Unified Storage System: Project level replication failing (clone local origin does not exist)

Asset ID:	1-72-1477890.1
Update Date:	2018-01-05
Keywords:

Solution Type Problem Resolution Sure

Solution 1477890.1 : Sun Storage 7000 Unified Storage System: Project level replication failing (clone local origin does not exist)

Applies to:

Sun ZFS Storage 7320 - Version All Versions and later
Oracle ZFS Storage ZS3-2 - Version All Versions and later
Oracle ZFS Storage ZS3-4 - Version All Versions and later
Oracle ZFS Storage ZS4-4 - Version All Versions and later
Sun Storage 7110 Unified Storage System - Version All Versions and later
7000 Appliance OS (Fishworks)

Symptoms

Project level replication started but fail to complete.

Alert log on the replication source indicates fail to send because of broken pipe and

the replication target indicates clone local origin does not exist.

Replication source alert log:
Wed Jul 18 08:36:57 2012
nvlist version: 0
  project = emsprod01
  target_host = <replication-target-hostname>
  source = appliance/kit/akd:default
  link = ca224476-3847-6584-b168-a2f2feb88a2b
  class = alert.ak.appliance.nas.project.replication.send.fail.misc
  result = failure
  ak_errmsg = stage 'stream_send' failed: zfs_send: cannot send 'pool-401/local/emsprod01': Broken pipe
  uuid = b7fdf6d5-e5c5-4323-bbab-92b9241a5fcf

Replication target alert log:
Wed Jul 18 08:36:57 2012
nvlist version: 0
  class = alert.ak.appliance.nas.project.replication.receive.fail.misc
  source = svc:/appliance/kit/akd:default
  link = 2a91bbc5-d681-c7c9-858d-dd85139a1054
  project = emsprod01
  source_host = <replication-source-hostname>
  ak_errmsg = zfs_receive failed: cannot receive: local origin for clone pool-454/nas-rr-9f2e6646-fa95-c306-c1cb-b0420b6a4088/emsprod01/ems_148773_1192@.rr-9f2e6646-fa95-c306-c1cb-b0420b6a4088-1 does not exist
  uuid = eec50bac-90fa-cad6-c413-e5ae277e5c62

Cause

The initial replication of a clone requires that the origin snapshot have already been replicated to the target or is being replicated as part of the same update.

NOTE: Replications snapshots that are on the target can be cloned, but the origin is not copied over - so when you try to replicate that new project it will fail.

See Document ID 1627414.1 Sun Storage 7000 Unified Storage System: How to Recover From Replication Failure - zfs_receive failed: cannot receive: local origin for clone does not exist.

Solution

Enable snapshot during initial project replication

On BUI -- Project > replication > click plus sign Actions > click Include Snapshots

NOTE: with code 8.6.3 and above the creation of a Replication action now includes a tick box to include " clone origin as data ". The project now replicated

can be cloned and the new cloned project should then be able to replicate without this error

From SR 3-11252663421 with similar source/target replication errors

Tue Aug 25 11:47:38 2015
nvlist version: 0
        time = 0x55dc55da
        hrtime = 0x6cf361189dec8b
        pkg = (embedded nvlist)
        nvlist version: 0
                source_asn = eca3cf64-8ded-ce56-c868-f60afdad11a5
                source_name = BL6UT040
                uuid = 37625d08-e605-44bf-9b87-a81984c4d965
                state = receiving
        (end pkg)

        event = recv_done
        result = failed
        error = zfs_receive failed: cannot receive: local origin for clone bl6ut040_oelpool/nas-rr-37625d08-e605-44bf-9b87-a81984c4d965/default/OEM12CREST@.auto-blrpark6ovm_snapshot-2015-08-01T18:30:00UTC does not exist

BL6UT040:shares (oelpool) default/OEM12CREST> ls
<snip>
pool = oelpool
origin = default/OEM12C@.zombie-6d9b <<-- attempt was made to remove the original snapshot
canonical_name = oelpool/local/default/OEM12CREST

From ZFS man pages

     origin

         For cloned file systems or volumes, the snapshot from
         which the clone was created. The origin cannot be des-
         troyed (even with the -r or -f options) so long as a
         clone exists.

     zfs promote clone-filesystem

         Promotes a clone file system to no longer be dependent
         on its origin snapshot.

Promote the clone and restart replication.

# zfs promote oelpool/local/default/OEM12CREST

Attachments

This solution has no attachment