[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Bug-wget] [bug #32054] Concurrent processes of wget on ftp directories
[Bug-wget] [bug #32054] Concurrent processes of wget on ftp directories produces comingled files
Tue, 25 Jul 2017 06:27:28 -0400 (EDT)
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_5) AppleWebKit/603.2.4 (KHTML, like Gecko) Version/10.1.1 Safari/603.2.4
Follow-up Comment #4, bug #32054 (project wget):
This is a genuine bug and I just spent a day chasing it, starting from random
failures in our tarball monitoring system.
If you have two wget processes started at the same time:
$ wget ftp://example.com/foo -O foo.html
$ wget ftp://example.com/bar -O bar.html
These will both write the FTP listing to .listing before processing it to
generate HTML, with the expected races.
Sometimes wget will fail because .listing was deleted before they need it.
Sometimes foo.html will contain the listing for /bar.
As this is a temporary file, can't wget just use mktemp?
Reply to this item at:
Message sent via/by Savannah
|[Prev in Thread]
||[Next in Thread]|
- [Bug-wget] [bug #32054] Concurrent processes of wget on ftp directories produces comingled files,
Ross Burton <=