@sgtholly regardless, the crawler is completely out of control and literally costing our customers money -- view the stats I posed. Wildly disproportionate.