having a 15 megabit bandwidth problem with search spiders on SO at the moment. Apparently setting rate limits in robots.txt doesn't work?