[Duplicity-talk] Backup succeeding but not writing manifest / sigtar

[Mark Grandi]

Running the command below seems to work, the backup completes fine, and the errors seem to just correspond to permission errors (i am excluding those directories but i guess duplicity still tries to read inside them....), but when the backup finishes, it doesn't actually write the sigtar or manifest files to the backup location, so essentially the backup fails for all duplicity cares. Running 'collection-status' will delete the sigtar and manifest files from the archive_dir directory, because they are not present in the backup location, and 'cleanup' will just list all the files (the gpg and par2 files) as 'extra files', for the same reason. Why is duplicity not writing / copying these files to the backup directory? 

It seems that it creates the  manifest.gpg and sigtar.gpg files and writes them to the archive_dir, but fails to copy them over to the backup location. If I copy these files to the backup location manually , then it suddenly recognizes it as a backup. 

command: 

duplicity --encrypt-sign-key 0x2CB2C0948891C4830B11AFB6E7B785F6FA5CBE16 --log-file ~/Temp/test_duplicity.log --name "Gypaetus-mgrandi" --use-agent --exclude-device-files --volsize 1024 --file-prefix "Gypaetus-mgrandi-" --exclude-filelist /Users/markgrandi/duplicity_exclude.txt / par2+file:///Volumes/mgrandi_256SSD/backup

log entries:

Reading globbing filelist /Users/markgrandi/duplicity_exclude.txt

Local and Remote metadata are synchronized, no sync needed.

Last full backup date: none

No signatures found, switching to full backup.

Error accessing possibly locked file /.DocumentRevisions-V100

Error accessing possibly locked file /.Spotlight-V100

Error accessing possibly locked file /.Trashes

Error accessing possibly locked file /.file

Error accessing possibly locked file /.fseventsd

Error accessing possibly locked file /Users/Guest/.CFUserTextEncoding

Error accessing possibly locked file /Users/Guest/Desktop

Error accessing possibly locked file /Users/Guest/Documents

Error accessing possibly locked file /Users/Guest/Downloads

Error accessing possibly locked file /Users/Guest/Library

Error accessing possibly locked file /Users/Guest/Movies

Error accessing possibly locked file /Users/Guest/Music

Error accessing possibly locked file /Users/Guest/Pictures

Error accessing possibly locked file /Users/Guest/Public/Drop Box

Error accessing possibly locked file /Users/markgrandi/.viminfo

Error accessing possibly locked file /Users/markgrandi/Library/Saved Application State/com.adobe.flashplayer.installmanager.savedState

Warning, found incomplete backup sets, probably left from aborted session

--------------[ Backup Statistics ]--------------

StartTime 1456382712.45 (Wed Feb 24 23:45:12 2016)

EndTime 1456386174.70 (Thu Feb 25 00:42:54 2016)

ElapsedTime 3462.25 (57 minutes 42.25 seconds)

SourceFiles 429045

SourceFileSize 22295414551 (20.8 GB)

NewFiles 429045

NewFileSize 22295414551 (20.8 GB)

DeletedFiles 0

ChangedFiles 0

ChangedFileSize 0 (0 bytes)

ChangedDeltaSize 0 (0 bytes)

DeltaEntries 429045

RawDeltaSize 22276747699 (20.7 GB)

TotalDestinationSizeChange 13905691762 (13.0 GB)

Errors 16

-------------------------------------------------

contents of ~/.cache/<archive_dir>/:

Gypaetus:Gypaetus-mgrandi markgrandi$ ls -la

total 1250080

drwxr-xr-x  6 markgrandi  staff        204 Feb 25 00:45 .

drwxr-xr-x  5 markgrandi  staff        170 Feb 24 23:45 ..

-rw-------  1 markgrandi  staff  295425508 Feb 25 00:44 Gypaetus-mgrandi-duplicity-full-signatures.20160225T064512Z.sigtar.gpg

-rw-------  1 markgrandi  staff  294998550 Feb 25 00:45 Gypaetus-mgrandi-duplicity-full-signatures.20160225T064512Z.sigtar.gz

-rw-------  1 markgrandi  staff   46875395 Feb 25 00:45 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.manifest

-rw-------  1 markgrandi  staff    2731077 Feb 25 00:45 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.manifest.gpg

contents of the backup dir:

Gypaetus:backup markgrandi$ ls -la

total 29885864

drwxr-xr-x  41 markgrandi  staff        1394 Feb 25 00:44 .

drwxrwxr-x  19 markgrandi  staff         714 Feb 24 23:42 ..

-rw-------   1 markgrandi  staff  1073732207 Feb 24 23:50 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol1.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 24 23:50 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol1.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107736576 Feb 24 23:50 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol1.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073782430 Feb 25 00:32 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol10.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:32 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol10.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107741376 Feb 25 00:32 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol10.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073806871 Feb 25 00:36 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol11.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:36 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol11.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107743776 Feb 25 00:36 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol11.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073771432 Feb 25 00:40 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol12.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:40 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol12.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107740576 Feb 25 00:40 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol12.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1020263590 Feb 25 00:44 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol13.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:44 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol13.difftar.gpg.par2

-rw-------   1 markgrandi  staff   102387776 Feb 25 00:44 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol13.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073752418 Feb 24 23:57 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol2.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 24 23:57 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol2.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107738976 Feb 24 23:57 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol2.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073807227 Feb 25 00:03 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol3.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:03 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol3.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107743776 Feb 25 00:03 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol3.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073807149 Feb 25 00:09 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol4.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:09 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol4.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107743776 Feb 25 00:09 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol4.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073742782 Feb 25 00:12 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol5.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:12 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol5.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107737376 Feb 25 00:12 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol5.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073808088 Feb 25 00:20 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol6.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:20 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol6.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107744576 Feb 25 00:20 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol6.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073817767 Feb 25 00:23 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol7.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:23 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol7.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107745376 Feb 25 00:23 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol7.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073811095 Feb 25 00:25 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol8.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:25 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol8.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107744576 Feb 25 00:25 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol8.difftar.gpg.vol000+200.par2

-rw-------   1 markgrandi  staff  1073788706 Feb 25 00:28 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol9.difftar.gpg

-rw-------   1 markgrandi  staff       40456 Feb 25 00:28 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol9.difftar.gpg.par2

-rw-------   1 markgrandi  staff   107742176 Feb 25 00:28 Gypaetus-mgrandi-duplicity-full.20160225T064512Z.vol9.difftar.gpg.vol000+200.par2

~Mark

signature.asc
Description: Message signed with OpenPGP using GPGMail