Re: [Duplicity-talk] how to tune duplicity for bigger files

[Jelle de Jong]

Hello everybody,

Yes I tried newer versions, I am still getting constant at X5680 @ 
3.33GHz and very slow 2MB/s upload. Works good with lots of small files 
though, but with big files it comes to a halt.

Any way I can I do to let duplicity work well with multi GB files?

# duplicity --version
duplicity 0.8.12

# gpg --version
gpg (GnuPG) 2.2.12

# python3 --version
Python 3.7.3

Kind regards,

Jelle de Jong

On 2020-03-30 21:46, Kenneth Loafman wrote:
> Have you tried the newer version?
>
> There are multiple options both stable and daily:
>
>   *
>     Stable tarball install - https://launchpad.net/duplicity/+download
>   *
>     Daily duplicity builds -
>     https://launchpad.net/~duplicity-team/+archive/ubuntu/daily-dev-trunk
>   *
>     Stable snap builds - “sudo snap install duplicity —classic"
>   *
>     Latest snap builds - “sudo snap install duplicity —classic —edge"
>   *
>     Latest pip builds - “sudo pip install duplicity" 
>
>
> NOTE: UNinstall duplicity first if it was installed via the distribution 
> repository. For Ubuntu that would be "sudo apt-get purge duplicity".
>
> On Mon, Mar 30, 2020 at 2:36 PM Jelle de Jong via Duplicity-talk 
> <address@hidden <mailto:address@hidden>> wrote:
>
>     Hello everybody,
>
>     My duplicity is really slow with bigger files and runs on 100% CPU load
>     for ages. I am doing backup of large files from 1GB to 100GB encrypted.
>
>     What can I do to speed this up?
>
>     Can I change the code how it calculate block size?
>     /usr/lib/python2.7/dist-packages/duplicity/diffdir.py
>
>     Are there any options that I can tune?
>     --max-blocksize=number
>
>     Kind regards,
>
>     Jelle de Jong
>
>     _______________________________________________
>     Duplicity-talk mailing list
>     address@hidden <mailto:address@hidden>
>     https://lists.nongnu.org/mailman/listinfo/duplicity-talk