Re: [Bug-wget] "Referer" when using spider mode

[Dale R. Worley]

Fernando Gont <address@hidden> writes:
> I'm using wget in a script to find broken and "moved" links in a web site.
>
> My problem is that, when parsing the output of "wget --spider", I cannot
> tell which page triggered the retrieval of a URL (i.e., the "referer" of
> such URL) -- so, while I can find that there are broken links, I cannot
> easily tell which page contains the broken link.
>
> Any clues on how to obtain such info?

I would grep through the files in the file tree that wget constructs.
That isn't perfect, but it's probably close enough for your purposes.

Dale