Re: [Sks-devel] Searching for freebsd leads to server crash, http erro 500

[Phil Pennock]

On 2017-01-15 at 14:50 +0000, David Evans wrote:
> Seaching for 'freebsd' leads to a server crash with exceptions raised and 
> returning http error code 500 - internal server error.

Trying on my server:

-----------------------------8< cut here >8-----------------------------
2017-01-16 16:01:09 Error handling request 
(GET,/pks/lookup?op=index&search=freebsd,[
accept:text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
accept-encoding:gzip, deflate, sdch, br
accept-language:en-US,en;q=0.8,en-GB;q=0.6
connection:close
dnt:1
host:sks.spodhuis.org:443
referer:https://sks.spodhuis.org/
upgrade-insecure-requests:1
user-agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_2) AppleWebKit/537.36 
(KHTML, like Gecko) Chrome/55.0.2883.95 Safari/537.36
x-forwarded-for:192.0.2.1
x-real-ip:192.0.2.1]): Invalid_argument("Too many responses")
-----------------------------8< cut here >8-----------------------------

(I've stripped my real current IP)

The server is still running.  It has not crashed.  It errored and
returned an appropriate HTML page in a 500 HTTP response.

So an exception was raised, and was handled, because there were too many
matches.

I'm not sure I want a public interface trying much harder to put load on
my machine when handling anonymous queries.  Perhaps a total count would
be nice, but ... I can live with the current behaviour as acceptable.

If you want to do serious analysis on basic keywords, I suggest grabbing
one of the public dumps of the dataset and doing off-line analysis.

-Phil