bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] wget2 Feature Suggestion - Triston Line


From: Triston Line
Subject: [Bug-wget] wget2 Feature Suggestion - Triston Line
Date: Thu, 12 Jul 2018 11:12:25 -0700

Hi Wget team,

I am but a lowly user and linux sysadmin, however, after noticing the wget2
project I have wondered about a feature that could be added to the new
version.

I approve of all the excellent new features already being added (especially
the PFS, Shoutcast and scanning features), but has there been any
consideration about continuing a "session" (Not a cookie session, a
recursive session)? Perhaps retaining the last command in a backup/log file
with the progress it last saved or if a script/command is interrupted and
entered again in the same folder, wget will review the existing files
before commencing the downloads and or link conversion depending on what
stage of the "session" it was at.

If that's possible that would help immensely. I "review" sites for my
friends at UBC and we look at geographic performance on their apache and
nginx servers, the only problem is they encounter minor errors from time to
time while recursively downloading (server-side errors nothing to do with
wget) so the session ends.

The other example I have is while updating my recursive downloads, we
encounter power-failures during winter storms and from time to time very
large recursions are interrupted and it feels bad downloading a web portal
your team made together consisting of roughly 25,000 or so web pages and at
the 10,000th page mark your wget session ends at like 3am. (Worse than
stepping on lego I promise).

Before you ask, no I don't download from sources I don't own unless it's
for work then we mirror other sites and I use wget for that as well (we
back up other government bodies related to us without needing higher
clearance, we simply provide wget with a login to an intranet system and
then it can make a backup with a basic user account access. It's also
useful for offline auditing of sites so that we can audit without their
team being interrupted or without them changing things on us).

Thanks for your time, I appreciate any feedback, hopefully I didn't miss an
incredibly obvious feature about wget2 although it would be spectacular
news to receive.

Triston Line


reply via email to

[Prev in Thread] Current Thread [Next in Thread]