Redirecting you to https://developers.google.com/search/docs/advanced/crawling/large-site-managing-crawl-budget