Codinghorror Twitter Archive
← All Tweets
Jeff Atwood
@codinghorror
Sep 28, 2009, 1:50:27 AM
r
@simonw
Pipes is crawling HTML when we explicitly told it not to in robots.txt. Verified logs. Result: perma-ban from all IP ranges.
0
1
Original Link