[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: wget crashes on a recursive download of my city's website
|
From: |
Tim Rühsen |
|
Subject: |
Re: wget crashes on a recursive download of my city's website |
|
Date: |
Sun, 12 Jun 2022 12:13:35 +0200 |
|
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.10.0 |
On 06.06.22 23:07, Eric Gallager wrote:
It took several hours before the crash happened, so I don't really
want to run the command again just to get a backtrace...
If you can get your hands on wget2: drop --preserve-permissions (FTP
only) and add --max-thread=50 to your command line.
Depending on your network speed, wget2 is much faster than wget here.
For me it took ~30mins (with wget2) vs 6 hours (with wget).
Regards, Tim
OpenPGP_signature
Description: OpenPGP digital signature