[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bug-wget] Add LIFO queue option for recursive download

From: Tim Ruehsen
Subject: Re: [Bug-wget] Add LIFO queue option for recursive download
Date: Mon, 05 Jan 2015 14:40:36 +0100
User-agent: KMail/4.14.2 (Linux/3.16.0-4-amd64; KDE/4.14.2; x86_64; ; )

On Monday 05 January 2015 13:59:12 John Peterson wrote:
> ## basic problem
> >as I understand your aim, you want Wget behave a bit more like a browser in
> >respect to downloading. This means after downloading the first HTML page,
> >first download non-HTML links (mainly images), second HTML pages.
> yes
> ## depth doesnt matter
> >I don't see a reason why the 'deepness' of those HTML pages should matter
> >when queuing. Since a user doesn't know how deep the link is that he
> >clicks on.
> yup. depth no matter
> ### enqueue html last isnt enough
> >This leads to a queuing without sorting: put the HTML links at the bottom
> >and the non-HTML links to the top. This would lead to a download order
> >that you documented under 'lifo download links directly after its parent
> >page'.
> keeping FIFO and enqueue html links last (with sort) isnt enough because all
> depth n links are still downloaded before any depth n+1 links
> FIFO enqueue html last ≠ LIFO enqueue html first

This is not what I said. I said:
enqueue html last + enqueue non-html first

This basically the same as having two queues: one for HTML and one for non-
HTML. non-HTML working as LIFO, always picked before HTML. If empty, pick from 
HTML queue (FIFO).


Attachment: signature.asc
Description: This is a digitally signed message part.

reply via email to

[Prev in Thread] Current Thread [Next in Thread]