Link Valet timeout
Link Valet, the Site Valet tool for checking HTML links, has always been a somewhat dangerous tool to run. Making lots of HTTP requests to external servers is inherently open to abuse, and particularly to a DoS attack on my server. That’s one reason I haven’t released the script: I can react to problems on my server, but don’t want to take on the responsibility for what might happen elsewhere.
I’ve made a few adjustments to restrict it over the years: reducing the timeout for checking a link, reducing the level of recursion available, denying access to known abusive ‘bots. But in the last few days, someone’s been abusing it to the point of overloading the server. So I’ve put in an additional limit: a timeout on the whole thing. That is, a graceful timeout: the script will complete, but will not check any more URLs after the timeout.
So far, it seems to be working:-)