bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] Timeouts need 'page' and 'byte' options


From: grarpamp
Subject: [Bug-wget] Timeouts need 'page' and 'byte' options
Date: Sat, 27 Sep 2014 01:07:35 -0400

So I set '-T 10' briefly thinking that, no matter what, wget
would exit, with an appropriate status, after 10 sec.

Yet on a slow loading page it keeps on slowly
receiving data up to around 210 sec, ie: how
long it takes to deliver the sample page I'm on.

wget 1.15 with connect/read/dns timeouts
being the only ones I see available.

I don't need the whole page, just status
off it after some while of the page coming
in and it is recorded to disk.

Can you add a --page-timeout which will
exit wget after n secs loading a single page?

I'd suggest a new exit code for the case
where we started receiving page bytes,
since on exit it would not be known if the page
would have completed, say according to
the size header.

And presumably if recursive or -i input mode,
do not exit, but move on to the next page.

I originally called this 'exec' timeout, but 'page'
timeout seemed more specific to this case.
You may want to call it 'slow' timeout, or
'load' timeout.

Note 'read' timeout never triggers because
page bytes just keep coming in slowly. And I
can't use 'read' because I want more of the page
written than just the 'read' interpacket time
would allow.

Also a 'byte' timeout is needed to keep on receiving
a page until a specific byte count. 'quota' does not
do this.

Thanks.



reply via email to

[Prev in Thread] Current Thread [Next in Thread]