Re: [Bug-wget] Using wget command to download from dynamic urls

[Pratap Kumar Das]

   Hi Tony,
   Thanks for the= suggestion.
   Well...the problem you mentioned was the first problem and now with the
   suggested step I am able to surpass that by using -O command.
   But still it doesn't download = the desired files. This is tested also on a
   machine with normal linux parti= tion.
   I am attaching the commands,logs a= nd the downloaded files.

   -bash-3.00$ wget -O ieee_paper.pdf 
   "[1]http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&;   
amp;arnumber=5173739&isnumber=5173690"
   --12:55:10--  [2]http://ie   
eexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5173739&isnumber   =5173690
              => `ieee_paper.pdf'
   Resolving iiscproxy1.serc.iisc.ernet.in... 10.16.40.12, 10.16.40.13, 10.16.  
 25.35, ...
   Connecting  to  [3]iiscproxy1.serc.iisc.ernet.in|10.16.40.12|:3128...   
connected.
   Proxy request sent, awaiting response... 302 Moved Temporarily
   Location: [4]http://ieeexplo   
re.ieee.org/stamp/stamp.jsp?tp=&arnumber=5173739&isnumber=517690
   [following]
   --12:55:11--  [5]htt   
p://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5173739&is   number=5173690
              => `ieee_paper.pdf'
   Connecting t= o [6]iiscp= roxy1.serc.iisc.ernet.in|10.16.40.12|:3128...
   connected.
   Proxy request sent, awaiting response... 200 OK
   Length: 612 [text/html]
   100%[=============   =========================   =================>]612      
        --.--K/s            
   12:55:= 12 (64.85 MB/s) - `ieee_paper.pdf' saved [612/612]
   -bash-3.00$ du -h ie= ee_paper.pdf
   4.0K    ieee_paper.pdf

   The ieee_paper.pdf is expected to be some MBs and = a valid pdf file...where
   as the downloaded one is a normal text file.  [3D"cid:33D@goomoji.gmail"]

   -bash-3.00$ wget -O fi= refox.log "[7]http   
://www.mozilla.com/products/download.html?product=firefox-3.5.1&os=   
win&lang=en-US"
   --13:02:19--  [8]http   
://www.mozilla.com/products/download.html?product=firefox-3.5.1&os=   
win&lang=en-US
              => `firefox.log'
   Resolving iiscproxy1.serc.iisc.ernet.in... 10.16.40.11, 10.16.40.12, 10.16.  
 40.13, ...
   Connecting  to  [9]iiscproxy1.serc.iisc.ernet.in|10.16.40.11|:3128...   
connected.
   Proxy request sent, awaiting response... 302 Moved Temporarily
   Location: [10]http   
://www.mozilla.com/en-US/products/download.html?product=firefox-3.5.1&   
;os=win&lang=en-US [following]
   --13:02:20-- 
   [11]http://www.mozilla.com/en-US/products/download.html?product=firefox-3.
   5= .1&os=win&lang=en-US
              => `firefox.exe'
   Connecting   to  <=  a  href="http://iiscproxy1.serc.iisc.ernet.in/";
   target="_blank">iiscprox= y1.serc.iisc.ernet.in|10.16.40.11|:3128...
   connected.
      Proxy request sent, awaiting response... 200 OK
   Length: unspecified [text/html]
            [         <=>                                                      
]33,598       41.58K/s               
   13:02:22 (41.55 KB/s) - `firef= ox.exe' saved [33598]
   -bash-3.= 00$ du -h firefox.log
   36K     firefox.log

   The firefox.log is expected to be some 16 MB and a valid exe file..= .where
   as  the  downloaded  one(attached)  is  a  normal  text  file. =  
   [3D"cid:33D@goomoji.gmail"]
   Is there any way to go from this and download the intended files just as d   
one by using a gui browser?  [3D"cid:B56@=]
   I am using wget version 1.11.4
   Thanks,
   Pratap

   On Sun, Jul 26, 2009 at 10= :37 AM, Tony Lewis <address@hidden>
   wrote:

   Pratap Kumar Das wrote:
   > I am not being able to download the files which would be
   >  linked  with dynamic urls (urls containing "*?*" in them whic= h is
   probably
   > used for redirection).

     The "?" is not the problem. See these lines in the output y= ou included:

   >  Cannot write to `download.html?product=firefox-3.5.1&os=win&am   
p;lang=en-US'
   > (File name too long).

     As far as I can tell, the "File name too long" error is onl= y generated
     on
     Windows machines so I'm assuming you're running on some version of      
Windows.
     For what it's worth, I am able to retrieve that file running wget in a<    
 br> cygwin shell running on Windows XP.
     What version of wget are you using?
     Tony

   --
   ****************= **************************************
   PRATAP KUMAR DAS
   Research Scho= lar
   VLSI Circuits and Systems Lab
   Dept of Electrical Communication En= gineering
   [13]I.I.Sc, Bangalore
   560012
   Mobile: +91944= 9974942
   ******************************************************

References

   1. 3D"http://ieeexp=/
   2. 3D"http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=   3. 
3D"http://iiscproxy1.serc.iisc.ernet.in=/
   4. 3D"http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&a   5. 
3D"http://ieeexplore.ieee.org/stamp/stamp.jsp   6. 
3D"http://iiscproxy1.serc.iisc.ernet.in/";
   7. 3D"http://www.mozilla.com/products/download.html?pr   8. 
3D"http://www.mozilla.com/products/download.html?pr   9. 
3D"http://iiscproxy1.serc.iisc.ernet.in=/
  10. 3D"http://www.mozilla.com/en-US/products/download.html?pr  11. 
3D"http://www.mozilla.com/en-US/products/download.h  12. 
3D"mailto:address@hidden  13. 3D"http://I.I.Sc"/

ieee_paper.pdf
Description: Adobe PDF document

firefox.log
Description: Binary data