An SEO professional asked John Mueller during a hangout about their blog posts being discovered but not indexed.
So they have run a 2-sided marketplace since 2013. This is fairly well-established, and they have about 70,000 pages, and about 70% of these pages are generally indexed.
Then there is this budget that crawls the new pages that get created. They see movement on those, so the old pages go out and the new pages come in.
At the same time, they are also writing blog entries from their editorial team.
And these get pushed to the top of the queue. They are always using the request indexing on those, so they will be indexed faster. They also add them to the sitemap.
But, they find that they write them, and then they want them to get onto Google as fast as possible.
They have been growing over the last year and they have more content on their site. They have seen that sometimes this doesn’t work as well for new blog entries, and they also see it in this “discovered but not indexed queue for a longer period of time.
Is there anything they can do to combat this? Like creating more internal links or something? Is this decision content-based? Or do they just have to live with the fact that some of their blog posts may not make it into the index?
John explained that it is normal for Google to not index everything on a website. This can happen to the entries they have on the site, and also the blog posts. It’s not tied to any specific kind of content.
John believes that using the URL inspection tool to submit them to indexing is fine. This is not going to cause any problems.
John would also try to find ways to make these pages as clear as possible that you care about things that should be indexed.
Internal linking is a good way to do that. To really ensure this happens, you can show on your homepage, “here are the five new blog posts,” and you link to them directly so that it’s easy for Googlebot. When they crawl and index your homepage they will see “Oh, there’s something new and it’s linked from the homepage,” it must be important.
This happens at approximately the 18:52 mark in the video.