@Carnage4Life if you are a web search engine your literal core competency *is* your crawler. Search results can only ever be as good as your crawl. And precious little competency has been demonstrated here over the last decade... since you asked.