Re: [Duplicity-talk] Restoring from Glacier to S3

[Benjamin Henrion]

On Wed, Jul 29, 2015 at 11:01 AM, Andrew Langhorn
<address@hidden> wrote:
> Compared to S3, Glacier will take a lot longer to restore. It's primary
> purpose is archiving whereas S3 is an object store. The trade-off is speed
> vs price, since you should rarely need to restore from a Glacier vault.
>
> Do you have auto-archiving set on your S3 bucket? You can check in the
> console. If so, turn that off, and your files should then stay in the S3

Yes, to 30 days, and the signature file I mentioned earlier is trapped
in glacier mode.

I will disable manually the S3 policy of 30 days and use the purge
--force command to 30 days instead.

It would be nice if both could be in sync because that would make a
restore quasi impossible, as the restore from Glacier is not that fast
and the process will timeout at some point.

> bucket assuming Duplicity isn't talking to Glacier some other way - which
> given the s3:// URIs being used seems unlikely, but is possible, I suppose.
>
> Do you have the sigfiles in the Duplicity cache? I might be wrong, but I
> thought that if they were in the cache, it wouldn't download them. It may be
> that the sigfiles it's downloading are new.

I tried to restore from another machine which did not had the cache.

Best,

> On Wednesday, 29 July 2015, Benjamin Henrion <address@hidden> wrote:
>>
>> Hi,
>>
>> I am restoring some files with duply, and it seems some files are
>> backuped to Glacier instead of S3 when I do the restore:
>>
>> ===============================
>> $ duply mybackup list
>>
>> [...]
>>
>> Listing s3://s3.amazonaws.com/mydata/myserver/
>> Synchronizing remote metadata to local cache...
>> File duplicity-full-signatures.20150626T073747Z.sigtar.gz is in
>> Glacier storage, restoring to S3
>> File duplicity-full-signatures.20150626T073747Z.sigtar.gz is in
>> Glacier storage, restoring to S3
>> File duplicity-full-signatures.20150628T070002Z.sigtar.gz is in
>> Glacier storage, restoring to S3
>> File duplicity-full.20150626T073747Z.manifest is in Glacier storage,
>> restoring to S3
>> File duplicity-full.20150628T070002Z.manifest is in Glacier storage,
>> restoring to S3
>> Copying duplicity-full-signatures.20150626T073747Z.sigtar.gz to local
>> cache.
>> Using temporary directory /tmp/duplicity-yReHpi-tempdir
>> Waiting for file duplicity-full-signatures.20150626T073747Z.sigtar.gz
>> to restore from Glacier
>>
>> ===============================
>>
>> Any idea how to avoid files to be copied to Glacier?
>>
>> It seems to take an enormous amount of time to restore.
>>
>> Also, I want to have some of your advices on how to restore files
>> quicker, when I do a "duply mybackup list", it copies all the
>> duplicity-full-signatures files, which can take gigabytes.
>>
>> Best,
>>
>> --
>> Benjamin Henrion <bhenrion at ffii.org>
>> FFII Brussels - +32-484-566109 - +32-2-4148403
>> "In July 2005, after several failed attempts to legalise software
>> patents in Europe, the patent establishment changed its strategy.
>> Instead of explicitly seeking to sanction the patentability of
>> software, they are now seeking to create a central European patent
>> court, which would establish and enforce patentability rules in their
>> favor, without any possibility of correction by competing courts or
>> democratically elected legislators."
>>
>> _______________________________________________
>> Duplicity-talk mailing list
>> address@hidden
>> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
>
>
>
> --
>



-- 
Benjamin Henrion <bhenrion at ffii.org>
FFII Brussels - +32-484-566109 - +32-2-4148403
"In July 2005, after several failed attempts to legalise software
patents in Europe, the patent establishment changed its strategy.
Instead of explicitly seeking to sanction the patentability of
software, they are now seeking to create a central European patent
court, which would establish and enforce patentability rules in their
favor, without any possibility of correction by competing courts or
democratically elected legislators."