bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: wget timeout does not work


From: Tim Rühsen
Subject: Re: wget timeout does not work
Date: Fri, 11 Mar 2022 20:16:48 +0100
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.1

Hey Dave,

just testing with wget 1.21.2 and it times out after 3s with your command line.

So this is a long fixed issue. Your wget 1.19.4 is from Jan 2018 and dozens or hundreds of issues has been fixed meanwhile. Please try to update.

Regards, Tim

On 08.03.22 22:45, Dave Henderson wrote:
Thanks for getting back in touch Tim.  Sorry it took a little bit to respond.  I tried your suggestion, but there is no difference in the outcome - wget still hangs.  Here is another URL to test:

https://www.usnews.com/news/politics/articles/2022-03-04/clinton-global-initiative-restarted-to-tackle-urgent-needs


I am using version 1.19.4 with the following switches:

wget -E -k -p -q -N --timeout=3 --tries=1 --server-response "URL"


Any other help would be appreciated!

Thanks,

Dave



On 2/25/22 9:33 AM, Tim Rühsen wrote:
On 16.02.22 00:32, Dave Henderson wrote:
Good afternoon.  I am trying to use wget to crawl some sites and one
of the sites that it gets to makes it get stuck.  I've tried using all
the timeout parameters, even each individually.  None of them work.
It just stays stuck.  Here's the link it is getting stuck on:

https://www.adidas.com/us/women-sports_bras?cm_mmc=AdiDisplay_-_-training-_--_-Billboard-_-Default_ad-_-dv%3ABrand-_-cn%3ABRAREVOLUTIONAPPSS22_Reach-_-pc%3Atraining&cm_mmc1=GLOBAL&cm_mmc2=adidas-GLOBAL-Brand-Display-training-Multiple-GLOBAL-BRAREVOLUTIONAPPSS22-2202

Looking forward to hearing back!

By default, wget retries up to 20x, with a growing time span between retries.

Just try --timeout=3 --tries=1.

Regards, Tim

Attachment: OpenPGP_signature
Description: OpenPGP digital signature


reply via email to

[Prev in Thread] Current Thread [Next in Thread]