improve crawl efficiency