[Duplicity-talk] Found signatures but no corresponding backup files.

[Marcus Gustafsson]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello!

We have just started using duplicity to backup one of our mailservers to
S3, but we have recently gotten problems that whenever we take a full
backup 2 incremental backups later the backups seems to become corrupted.
I googled on the error message, but didn't manage to find out anything
obvious. Anyone have a good idea of where I should start looking?

We are running 0.4.3.RC2 and the commands are as follows:

========== For the incremental backups (every day except when the full
backup runs):

export S3KEY=<S3KEY>
export S3SECRET=<S3PASS>
export PASSPHRASE=<GPG PASSPHRASE>
/bin/nice /usr/bin/duplicity --encrypt-key 0xADB77428 /opt/zimbra/backup
s3+http://mailserverbucket

========= For the full backups (only run once a week):

export S3KEY=<S3KEY>
export S3SECRET=<S3PASS>
export PASSPHRASE=<GPG PASSPHRASE>
/bin/nice /usr/bin/duplicity --full --encrypt-key 0xADB77428
/opt/zimbra/backup s3+http://mailserverbucket

# Remove backups older than one week (Zimbra still keeps backups for
# much longer, so this is just double storage anyway).
/bin/nice /usr/bin/duplicity --force --encrypt-key 0xADB77428
- --remove-older-than 1W s3+http://mailserverbucket


================ Output from the cron script
(last incremental before the full backup):

Network error '(32, 'Broken pipe')'. Trying to reconnect in 10 seconds.
- --------------[ Backup Statistics ]--------------
StartTime 1186819283.06 (Sat Aug 11 03:01:23 2007)
EndTime 1186823494.50 (Sat Aug 11 04:11:34 2007)
ElapsedTime 4211.44 (1 hour 10 minutes 11.44 seconds)
SourceFiles 870914
SourceFileSize 162810117608 (152 GB)
NewFiles 55922
NewFileSize 7549148023 (7.03 GB)
DeletedFiles 0
ChangedFiles 68
ChangedFileSize 76247 (74.5 KB)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 55990
RawDeltaSize 4931420210 (4.59 GB)
TotalDestinationSizeChange 4537891743 (4.23 GB)
Errors 0
- -------------------------------------------------

(the full backup):
Network error 'BitBucketError[500]: Internal Server Error'. Trying to
reconnect in 10 seconds.
Network error 'timed out'. Trying to reconnect in 10 seconds.
Network error 'timed out'. Trying to reconnect in 10 seconds.
- --------------[ Backup Statistics ]--------------
StartTime 1186903839.85 (Sun Aug 12 02:30:39 2007)
EndTime 1187002191.86 (Mon Aug 13 05:49:51 2007)
ElapsedTime 98352.01 (27 hours 19 minutes 12.01 seconds)
SourceFiles 871257
SourceFileSize 162832269473 (152 GB)
NewFiles 871257
NewFileSize 162832269473 (152 GB)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 871257
RawDeltaSize 92448690151 (86.1 GB)
TotalDestinationSizeChange 98091728310 (91.4 GB)
Errors 0
- -------------------------------------------------

Warning, found the following orphaned signature files:
duplicity-new-signatures.2007-08-11T02:30:03-05:00.to.2007-08-13T02:30:02-05:00.sigtar.gpg
Found signatures but no corresponding backup files

(The next incremental backup):
Warning, found incomplete backup sets, probably left from aborted session
Network error '(32, 'Broken pipe')'. Trying to reconnect in 10 seconds.
- --------------[ Backup Statistics ]--------------
StartTime 1186992150.62 (Mon Aug 13 03:02:30 2007)
EndTime 1186992912.82 (Mon Aug 13 03:15:12 2007)
ElapsedTime 762.21 (12 minutes 42.21 seconds)
SourceFiles 871811
SourceFileSize 162846837152 (152 GB)
NewFiles 966
NewFileSize 37010360 (35.3 MB)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 966
RawDeltaSize 12897100 (12.3 MB)
TotalDestinationSizeChange 19963809 (19.0 MB)
Errors 0
- -------------------------------------------------

(And the final incremental one. Everything after this gives the same error):
Warning, found the following orphaned signature files:
duplicity-new-signatures.2007-08-11T02:30:03-05:00.to.2007-08-13T02:30:02-05:00.sigtar.gpg
Found signatures but no corresponding backup files


Regards,
 Marcus Gustafsson
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFGwWqFzYC0ZmFVS9sRAgy8AJ9bTp5ZIR/Uy79v8WZPXJQyju+e+ACeLJOi
zoyKCD08c3QCMsXQxuwHO/U=
=LauG
-----END PGP SIGNATURE-----