Re: [Bug-wget] Add LIFO queue option for recursive download

[Tim Ruehsen]

On Monday 05 January 2015 13:59:12 John Peterson wrote:
> ## basic problem
> 
> 
> >as I understand your aim, you want Wget behave a bit more like a browser in
> >respect to downloading. This means after downloading the first HTML page,
> >first download non-HTML links (mainly images), second HTML pages.
> 
> yes
> 
> 
> ## depth doesnt matter
> 
> 
> >I don't see a reason why the 'deepness' of those HTML pages should matter
> >when queuing. Since a user doesn't know how deep the link is that he
> >clicks on.
> 
> yup. depth no matter
> 
> 
> ### enqueue html last isnt enough
> 
> 
> >This leads to a queuing without sorting: put the HTML links at the bottom
> >and the non-HTML links to the top. This would lead to a download order
> >that you documented under 'lifo download links directly after its parent
> >page'.
> 
> keeping FIFO and enqueue html links last (with sort) isnt enough because all
> depth n links are still downloaded before any depth n+1 links
 
> FIFO enqueue html last ≠ LIFO enqueue html first

This is not what I said. I said:
enqueue html last + enqueue non-html first

This basically the same as having two queues: one for HTML and one for non-
HTML. non-HTML working as LIFO, always picked before HTML. If empty, pick from 
HTML queue (FIFO).

Tim

signature.asc
Description: This is a digitally signed message part.