During a hangout, one SEO professional asked John Mueller during his question and answer segment about their crawls in Search Console.
In their Search Console Report, 97 percent of the crawler requests are refreshed crawls, and 3 percent are discovery crawls.
Their main question is what can they do to optimize this and have Google discover more pages?
Johne explained that they don’t have any guidelines on how the balance should be and how you should tweak it.
In general, it’s normal for an older, more established website to have a lot of refresh crawls because they willlook at the amount of pages they know about that grows over time.
And the amount of new pages that come in tends to be stable. So it’s pretty common, especially for a site that’s established and just slowly growing to have a balance like this that most of the crawling is on the refresh crawling side and not so much on the discovery crawling side.
John thinks it would be different if you had a short-lived site. Maybe classifieds, or for local news where you have a lot of new articles that come in and the old content becomes irrelevant very quickly.
Then he thinks they would focus more on Discovery.
But especially if you have something like an e-commerce site where you’re just growing the amount of content that you have slowly and most of the old content remains valid.
John sees the refresh crawling there is likely going to be higher.
This happens at approximately the 33:32 mark in the video.