bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] Feature request: option to not download rejected files


From: Zoe Blade
Subject: [Bug-wget] Feature request: option to not download rejected files
Date: Fri, 29 Jun 2018 11:49:45 +0100

Hi!

First of all, I find wget very useful, so thank you to everyone who has 
contributed to it!

I gather that the rejection list (--reject and --reject-regex) is used to 
determine which downloaded files to permanently save or not.  While that's 
sometimes useful, there are other times it would be more useful to avoid 
downloading rejected files altogether.

For example, rejecting any file with a question mark in it, to avoid 
duplication due to endless combinations of parameters.  It would put far less 
strain on the server to be able to just download the main version of each page 
and not its various iterations.

Someone even went as far as to write a quick hack to add this functionality for 
themselves: 
https://stackoverflow.com/questions/12704197/wget-reject-still-downloads-file  
It would be much nicer if it was built in, in a more robust and extensible 
manner.

Thanks,
Zoë.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]