Re: [Duplicity-talk] how to tune duplicity for bigger files

[edgar . soldin]

might be a bug. maybe somewhere memory is not released until the file is closed 
and hogs memory until the system starts paging. can you monitor memory usage 
development during such a slow backup?

..ede/duply.net

On 06.04.2020 19:57, Jelle de Jong via Duplicity-talk wrote:
> Hello everybody,
>
> Yes I tried newer versions, I am still getting constant at X5680 @ 3.33GHz 
> and very slow 2MB/s upload. Works good with lots of small files though, but 
> with big files it comes to a halt.
>
> Any way I can I do to let duplicity work well with multi GB files?
>
> # duplicity --version
> duplicity 0.8.12
>
> # gpg --version
> gpg (GnuPG) 2.2.12
>
> # python3 --version
> Python 3.7.3
>
> Kind regards,
>
> Jelle de Jong
>
> On 2020-03-30 21:46, Kenneth Loafman wrote:
>> Have you tried the newer version?
>>
>> There are multiple options both stable and daily:
>>
>>   *
>>     Stable tarball install - https://launchpad.net/duplicity/+download
>>   *
>>     Daily duplicity builds -
>>     https://launchpad.net/~duplicity-team/+archive/ubuntu/daily-dev-trunk
>>   *
>>     Stable snap builds - “sudo snap install duplicity —classic"
>>   *
>>     Latest snap builds - “sudo snap install duplicity —classic —edge"
>>   *
>>     Latest pip builds - “sudo pip install duplicity"
>>
>> NOTE: UNinstall duplicity first if it was installed via the distribution 
>> repository. For Ubuntu that would be "sudo apt-get purge duplicity".
>>
>> On Mon, Mar 30, 2020 at 2:36 PM Jelle de Jong via Duplicity-talk 
>> <address@hidden <mailto:address@hidden>> wrote:
>>
>>     Hello everybody,
>>
>>     My duplicity is really slow with bigger files and runs on 100% CPU load
>>     for ages. I am doing backup of large files from 1GB to 100GB encrypted.
>>
>>     What can I do to speed this up?
>>
>>     Can I change the code how it calculate block size?
>>     /usr/lib/python2.7/dist-packages/duplicity/diffdir.py
>>
>>     Are there any options that I can tune?
>>     --max-blocksize=number
>>
>>     Kind regards,
>>
>>     Jelle de Jong
>>
>>     _______________________________________________
>>     Duplicity-talk mailing list
>>     address@hidden <mailto:address@hidden>
>>     https://lists.nongnu.org/mailman/listinfo/duplicity-talk
>>
>
> _______________________________________________
> Duplicity-talk mailing list
> address@hidden
> https://lists.nongnu.org/mailman/listinfo/duplicity-talk