|
From: | atar |
Subject: | [Bug-wget] wget downlaod the robots.txt file even with '-R txt' |
Date: | Thu, 08 Aug 2013 05:51:08 -0000 |
User-agent: | Opera Mail/12.16 (Linux) |
Hi there!wget download the robots.txt file although the '-R txt' option was specified.
How to solve this problem? Thanks in advance!! atar.
[Prev in Thread] | Current Thread | [Next in Thread] |