bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: wget timeout does not work


From: Dave Henderson
Subject: Re: wget timeout does not work
Date: Tue, 8 Mar 2022 16:45:34 -0500
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.14.0

Thanks for getting back in touch Tim.  Sorry it took a little bit to respond.  I tried your suggestion, but there is no difference in the outcome - wget still hangs.  Here is another URL to test:

https://www.usnews.com/news/politics/articles/2022-03-04/clinton-global-initiative-restarted-to-tackle-urgent-needs


I am using version 1.19.4 with the following switches:

wget -E -k -p -q -N --timeout=3 --tries=1 --server-response "URL"


Any other help would be appreciated!

Thanks,

Dave



On 2/25/22 9:33 AM, Tim Rühsen wrote:
On 16.02.22 00:32, Dave Henderson wrote:
Good afternoon.  I am trying to use wget to crawl some sites and one
of the sites that it gets to makes it get stuck.  I've tried using all
the timeout parameters, even each individually.  None of them work.
It just stays stuck.  Here's the link it is getting stuck on:

https://www.adidas.com/us/women-sports_bras?cm_mmc=AdiDisplay_-_-training-_--_-Billboard-_-Default_ad-_-dv%3ABrand-_-cn%3ABRAREVOLUTIONAPPSS22_Reach-_-pc%3Atraining&cm_mmc1=GLOBAL&cm_mmc2=adidas-GLOBAL-Brand-Display-training-Multiple-GLOBAL-BRAREVOLUTIONAPPSS22-2202

Looking forward to hearing back!

By default, wget retries up to 20x, with a growing time span between retries.

Just try --timeout=3 --tries=1.

Regards, Tim



reply via email to

[Prev in Thread] Current Thread [Next in Thread]