|
From: | Kenneth Loafman |
Subject: | Re: [Duplicity-talk] how to tune duplicity for bigger files |
Date: | Tue, 7 Apr 2020 10:19:25 -0500 |
might be a bug. maybe somewhere memory is not released until the file is closed and hogs memory until the system starts paging. can you monitor memory usage development during such a slow backup?
..ede/duply.net
On 06.04.2020 19:57, Jelle de Jong via Duplicity-talk wrote:
> Hello everybody,
>
> Yes I tried newer versions, I am still getting constant at X5680 @ 3.33GHz and very slow 2MB/s upload. Works good with lots of small files though, but with big files it comes to a halt.
>
> Any way I can I do to let duplicity work well with multi GB files?
>
> # duplicity --version
> duplicity 0.8.12
>
> # gpg --version
> gpg (GnuPG) 2.2.12
>
> # python3 --version
> Python 3.7.3
>
> Kind regards,
>
> Jelle de Jong
>
> On 2020-03-30 21:46, Kenneth Loafman wrote:
>> Have you tried the newer version?
>>
>> There are multiple options both stable and daily:
>>
>> *
>> Stable tarball install - https://launchpad.net/duplicity/+download
>> *
>> Daily duplicity builds -
>> https://launchpad.net/~duplicity-team/+archive/ubuntu/daily-dev-trunk
>> *
>> Stable snap builds - “sudo snap install duplicity —classic"
>> *
>> Latest snap builds - “sudo snap install duplicity —classic —edge"
>> *
>> Latest pip builds - “sudo pip install duplicity"
>>
>> NOTE: UNinstall duplicity first if it was installed via the distribution repository. For Ubuntu that would be "sudo apt-get purge duplicity".
>>
>> On Mon, Mar 30, 2020 at 2:36 PM Jelle de Jong via Duplicity-talk <address@hidden <mailto:address@hidden>> wrote:
>>
>> Hello everybody,
>>
>> My duplicity is really slow with bigger files and runs on 100% CPU load
>> for ages. I am doing backup of large files from 1GB to 100GB encrypted.
>>
>> What can I do to speed this up?
>>
>> Can I change the code how it calculate block size?
>> /usr/lib/python2.7/dist-packages/duplicity/diffdir.py
>>
>> Are there any options that I can tune?
>> --max-blocksize=number
>>
>> Kind regards,
>>
>> Jelle de Jong
>>
>> _______________________________________________
>> Duplicity-talk mailing list
>> address@hidden <mailto:address@hidden>
>> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
>>
>
> _______________________________________________
> Duplicity-talk mailing list
> address@hidden
> https://lists.nongnu.org/mailman/listinfo/duplicity-talk
_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
[Prev in Thread] | Current Thread | [Next in Thread] |