Codinghorror Twitter Archive
← All Tweets
avatar
Jeff Atwood @codinghorror
Sep 28, 2009, 1:50:27 AM
r @simonw Pipes is crawling HTML when we explicitly told it not to in robots.txt. Verified logs. Result: perma-ban from all IP ranges.