[Lynx-dev] -crawl -traversal with source

[Donovan Craig]

Hi,

I'm after a way to automatically spider a site which requires cookies. I
need to get the source as opposed to the formatted content.

I've tried using wget with the load cookies option instead of using
lynx but it seems that lynx is smarter when following re-directs as wget
gets stuck with these.

Is there any way (or does anyone have a script) to do a -crawl
-traversal to get the source code instead of the formatted output?

Thank's.

Regards,

Donovan