Link Valet timeout

Link Valet, the Site Valet tool for checking HTML links, has always been a somewhat dangerous tool to run.  Making lots of HTTP requests to external servers is inherently open to abuse, and particularly to a DoS attack on my server.  That’s one reason I haven’t released the script: I can react to problems on my server, but don’t want to take on the responsibility for what might happen elsewhere.

I’ve made a few adjustments to restrict it over the years: reducing the timeout for checking a link, reducing the level of recursion available, denying access to known abusive ‘bots.  But in the last few days, someone’s been abusing it to the point of overloading the server.  So I’ve put in an additional limit: a timeout on the whole thing.  That is, a graceful timeout: the script will complete, but will not check any more URLs after the timeout.

So far, it seems to be working:-)

Posted on December 27, 2007, in site valet. Bookmark the permalink. Leave a comment.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: