Irrelevant Noise
I’d always assumed from the name that relevantnoise.com was some kind of blogosphere search engine. Gods know they spidered this site often enough. So, under the impression they were meaningful and worthwhile, I put up with their unprofessional scraping that would have gotten most others blacklisted a while ago:
64.21.98.196 - - [da/te/2007:HH:MM:24 -0600] “GET /feed/ HTTP/1.1″ 200 41843 “-” “-”
64.21.98.196 - - [29/Jan/2007:HH:MM:57 -0600] “GET /feed/ HTTP/1.1″ 200 41843 “-” “http://www.relevantnoise.com; info@relevantnoise.com”
But it turns out they’re actually a corporate intelligence service, just like the much-loathed Cyveillance. So… Here, anyway, spying for big business, together with what is either incredibly bad software design or a paranoid approach to scraping content off the web (requests from the same IP, for the same feed, thirty-three seconds apart, one with and one without a user-agent? WTF?), gets you banned. The usual offending IP is 64.21.98.196; the relevant netblock is 64.21.98.192/27.
Thanks go to A Daily Rant for pointing out Relevant Noise’s irrelevance.
You can leave a response, or trackback from your own site.