Re: [Lynx-dev] Lynx fails on http://politiken.dk

[Walter Ian Kaye]

At 04:21p +0000 10/11/2004, Thorsten Glaser didst inscribe upon an 
electronic papyrus:

> They are actively blocking anyone with libwww-FM/2.14 in their user agent
> string (I tested for that). (Actually, libwww is enough.)
>
> That's not a bug in lynx, and you can change the user agent in the
> (O)ptions page.
> On the other hand, I would consider contacting them and asking if
> they are still all in their right mind...


This might explain it:

--- begin forwarded text

Date: Fri, 04 Jul 2003 23:29:45 +0200
From: Erik-Jan van Baaren
Subject: Re: contact-guitarboard

But I have 6000 bookmarks in Lynx!

> Hey wait a sec -- MSIE users can set their browser to download 
> multiple levels of a Web site. Do you block all IE users? If not, 
> then you should not block all Lynx users, either.
>
> In the meantime, I fudged my UA string (changed libwww to lib_www). 
> Which, btw, "bad people" could do too, so you really should block by 
> IP address.
>
> dank u vel,
> -Walter
> ___________________________________________________________________________
>  Walter Ian Kaye, Menlo Park, CA, USA | Macintosh Scripter, Web Developer,
>  http://www.natural-innovations.com/  | Guitarist, Songwriter, Actor, and
>                                       | Whole Grain Baker
>  (())  ascii ribbon campaign:
>   XX   just say no to HTML/RTF in email and usenet
>  //\\  and no to Web sites that do not fully support Lynx

I am banning on ip addresses but also on some UA strings like libwww 
and common rippers. Lynx is probably a nice ripper to use for the 
website-ripping people.
But you are right.. i shouldn't ban lynx and never wanted to ban it. 
I didn't even know libwww was in it's UA string. I removed it from 
the list.

Erik

--- end forwarded text