Re: [Duplicity-talk] Sometimes reads manifest from backup location even though it's in cache -- why?

[edgar . soldin]

maybe i can beat you to it, but i am not very certain. in any way, please just 
drop a short note if you find the time, i'll do the same.. ede

On 18.04.2013 01:54, Kenneth Loafman wrote:
> I'm short on time as well.  It should not read the remote unless the local 
> one was not found.  I'll look into it when I get the time.
> 
> ...Ken
> 
> 
> 
> On Wed, Apr 17, 2013 at 2:26 AM, <address@hidden <mailto:address@hidden>> 
> wrote:
> 
>     yeah, please file a bug on launchpad, but check if there is a similar 
> entry first please.
>     also point to this mail thread (via gmane or some) for others to read.
> 
>     i still haven't and probably for some time will not have time to disect 
> the issue.
>     first and foremost. the local cache (archive-dir) functionality was 
> introduced with 0.6 by Kenneth (the maintainer), so we should ask him what he 
> thinks the issue is here. i tried before, but haven't got an anser. i'll cc 
> him again.
> 
>     Ken: any idea on this? cite from below: "duplicity will sometimes decide 
> to retrieve a manifest from the remote backup location even though there's a 
> copy in the local cache"
> 
> 
>     ..ede/duply.net <http://duply.net>
> 
> 
>     On 17.04.2013 04:04, address@hidden <mailto:address@hidden> wrote:
>     > So I guess I should just turn this into a bug report? Concerns me that 
> I don't see a good way for the maintainer to reproduce the bug, which is 
> going to make it hard to fix.
>     >
>     > One circumstance that was different when it failed from when it worked 
> is this: I was running nightly backups, then the machines all got shut down 
> for a week and a half, and it was when I started them back up that this 
> failure appeared. Does duplicity like to retrieve the manifest from the 
> remote if it's more than a week old?
>     >
>     >  - Dave Cottingham
>     >
>     > 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------!
>      ---
>     > *From: address@hidden <mailto:address@hidden>
>     > *To: *"Discussion of the backup program duplicity" <address@hidden 
> <mailto:address@hidden>>
>     > *Sent: *Friday, April 12, 2013 3:16:58 PM
>     > *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup 
> location even though it's in cache -- why?
>     >
>     > Here's the log file, gzipped. I should've thought of that myself.
>     >
>     > Thanks,
>     > Dave Cottingham
>     >
>     > 
> ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------!
>      ---
>     > *From: *"edgar soldin" <address@hidden <mailto:address@hidden>>
>     > *To: *"Discussion of the backup program duplicity" <address@hidden 
> <mailto:address@hidden>>
>     > *Sent: *Friday, April 12, 2013 2:05:00 PM
>     > *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup 
> location even though it's in cache -- why?
>     >
>     > did you try zipping it? else just put it on some filehoster/pastebin 
> ..ede/duply.net <http://duply.net>
>     >
>     > On 12.04.2013 19:03, address@hidden <mailto:address@hidden> wrote:
>     >> I see the same problem with 0.6.21.
>     >>
>     >> I found that one of my other machines was already running the latest 
> version. It similarly fails when it decides to retrieve the latest manifest 
> from the remote location, although the manifest is in the local cache.
>     >>
>     >> I tried sending this message this morning with the "-v9" log attached, 
> and it never appeared on the list, so I'm trying again without the 
> attachments. If this gets through I'll try sending the log in a subsequent 
> message.
>     >>
>     >> Thanks,
>     >> Dave Cottingham
>     >>
>     >> 
> --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------!
>      ----
>     >> *From: *"edgar soldin" <address@hidden <mailto:address@hidden>>
>     >> *To: *"Discussion of the backup program duplicity" <address@hidden 
> <mailto:address@hidden>>
>     >> *Sent: *Monday, April 8, 2013 12:36:40 PM
>     >> *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup 
> location even though it's in cache -- why?
>     >>
>     >> looks like you are right. it explicitely states that the metadata is 
> in sync, hence it should use the local copy.
>     >>
>     >> before anything else. please try the latest release 0.6.21. install it 
> from tarball if your distro does not sport in the repository. directions here 
> http://duply.net/?title=Duply-documentation under section TIP.
>     >> we have had lot's of fixes since your version.
>     >>
>     >> @Ken: any idea why it still tries to download it?
>     >>
>     >> ..ede/duply.net <http://duply.net>
>     >>
>     >> On 08.04.2013 17:29, address@hidden <mailto:address@hidden> wrote:
>     >>> Here's the output of "-v9" for one of my backups. It's quite 
> voluminous, so I've put it in an attachment.
>     >>>
>     >>> I've also attached a list of the archive dir -- looks to me like the 
> file it's trying to retrieve is already cached.
>     >>>
>     >>> Thanks,
>     >>> Dave Cottingham
>     >>>
>     >>> 
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------!
>      -----
>     >>> *From: *"edgar soldin" <address@hidden <mailto:address@hidden>>
>     >>> *To: *"Discussion of the backup program duplicity" <address@hidden 
> <mailto:address@hidden>>
>     >>> *Sent: *Monday, April 8, 2013 9:05:07 AM
>     >>> *Subject: *Re: [Duplicity-talk] Sometimes reads manifest from backup 
> location even though it's in cache -- why?
>     >>>
>     >>> On 08.04.2013 02:58, address@hidden <mailto:address@hidden> wrote:
>     >>>> I see that duplicity will sometimes decide to retrieve a manifest 
> from the remote backup location even though there's a copy in the local 
> cache. Can anyone clarify what circumstances cause this to happen, and why?
>     >>>>
>     >>>> Here's why I care. I am backing up to Amazon S3 and using a 
> lifecycle rule to transition everything to Glacier. So, of course, nothing 
> can be retrieved without prior manual intervention. I expected this to work 
> since the local cache has everything duplicity needs, and in fact this worked 
> with nightly backups for over two weeks. But now duplicity fails because it 
> is trying to retrieve the last manifest, even though that file is in the 
> cache.
>     >>>>
>     >>>
>     >>> question is why. do you have an extra verbose '-v9' output for us? 
> obfuscate private strings in it and post it here.
>     >>>
>     >>> ..ede/duply.net <http://duply.net>
>     >>>
> 
>