bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bug-wget] help


From: Ray Satiro
Subject: Re: [Bug-wget] help
Date: Tue, 14 Dec 2010 19:32:47 -0800 (PST)

--- On Mon, 12/13/10, Live-Email <address@hidden> wrote:
For instance, the following is year=2010, month=11, day=01 to 07. I used the 
following command but it failed.

wget -r -l 3 -A"*.*" 
http://weather.uwyo.edu/cgi-bin/sounding?region=seasia&TYPE=TEXT%3ALIST&YEAR=2010&MONTH=11&FROM=0100&TO=0712&STNM=45004%3A

Hi,

You need to place quotes around a URL like that because of special characters, 
the ampersands and maybe others depending on your shell.

no:
wget http://abchost/whatever?fruit=apple&color=red
yes:
wget "http://abchost/whatever?fruit=apple&color=red";

The actual download in your case is rejected however because of what's in the 
server's robots.txt. It has a disallow on /cgi-bin
For more read this
http://addictivecode.org/FrequentlyAskedQuestions#robots

You could disable robots.txt (not polite) or in your example case it looks like 
disabling recursion would be just as good:
wget 
"http://weather.uwyo.edu/cgi-bin/sounding?region=seasia&TYPE=TEXT:LIST&YEAR=2010&MONTH=11&FROM=0100&TO=0712&STNM=45004:";







      


reply via email to

[Prev in Thread] Current Thread [Next in Thread]