[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Bug-wget] downloading links in a dynamic site
From: |
Vinh Nguyen |
Subject: |
[Bug-wget] downloading links in a dynamic site |
Date: |
Sun, 25 Jul 2010 12:09:41 -0700 |
Dear list,
My goal is to download some pdf files from a dynamic site (not sure on
the terminology). For example, I would execute:
wget -U firefox -r -l1 -nd -e robots=off -A '*.pdf,*.pdf.*'
http://site.com/?sortorder=asc&p_o=0
and would get my 10 pdf files. On the page I can click a "Next" link
(to have more files), and I execute:
wget -U firefox -r -l1 -nd -e robots=off -A '*.pdf,*.pdf.*'
http://site.com/?sortorder=asc&p_o=10
However, the downloaded files are identical to the previous. I tried
the cookies setting and referer setting:
wget -U firefox --cookies=on --keep-session-cookies
--save-cookies=cookie.txt -r -l1 -nd -e robots=off -A '*.pdf,*.pdf.*'
http://site.com/?sortorder=asc&p_o=0
wget -U firefox --referer='http://site.com/?sortorder=asc&p_o=0'
--cookies=on --load-cookies=cookie.txt --keep-session-cookies
--save-cookies=cookie.txt -r -l1 -nd -e robots=off -A '*.pdf,*.pdf.*'
http://site.com/?sortorder=asc&p_o=10
but the results again are identical. Any suggestions?
Thanks.
Vinh
- [Bug-wget] downloading links in a dynamic site,
Vinh Nguyen <=