bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [Bug-wget] How to do selective download using wget ?


From: Tony Lewis
Subject: RE: [Bug-wget] How to do selective download using wget ?
Date: Wed, 21 Jul 2010 11:05:06 -0400

Avinash wrote:

> However, the program seems to want to waste a ton of bandwidth in
> downloading EVERYTHING linked from the website you feed it, and then as it
> finishes download it, it removes it if it's not an mp3. Is there any way
to
> tell it, "seriously, if it doesn't end in .mp3, don't even bother to touch
> it."
>
> Why does wget download it and then reject it ?

In order to mirror a website, wget has to download all pages looking for
HTML content to find the links of the MP3 files that you want to keep.

There have been discussions about improving the performance by looking at
message headers and ignoring files that don't claim to be HTML or match the
--accept criteria. Feel free to work on that enhancement. :-)

Tony




reply via email to

[Prev in Thread] Current Thread [Next in Thread]