Google: Noindexed Pages Do Not Effect Crawl Budget Plan

Posted by

Google’s Search Relations team confirms that noindexed pages don’t adversely impact a website’s crawl budget, no matter how many a site has.

This topic is resolved not once however thrice during the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Browse Advocates John Mueller and Gary Illyes take turns addressing three comparable concerns from individuals worried they have a lot of noindexed pages on their websites.

From Mueller’s and Illyes’ responses, we learn there’s no such thing as “a lot of” indexed pages. Further, unless your website has more than a million pages, there’s no requirement to fret about crawl budget.

Here’s a quick recap of each concern and answer.

Question 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a concern asking if an “excessive” variety of indexed pages is a concern for discovery or indexed.

Illyes states noindex is a tool to assist websites keep material out of online search engine. Google encourages using the noindex tag when essential, and because of that, there are no unfavorable impacts connected with it.

“Noindex is an extremely effective tool that search engines support to assist you, this website owner, keep content out of their indexes. For this factor, it doesn’t carry any unintended effects when it concerns crawling and indexing. For instance, having lots of pages with noindex will not affect how Google crawls and indexes your website.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following concern comes up at the 10:22 mark:

“Should we keep an eye on the ratio between indexed and non-indexed pages in Search Console in order to better acknowledge possibly squandered crawl budget on non-indexed pages?”

Mueller debunks that sites should attempt to stabilize their indexed and nonindexed pages.

To that end, crawl budget plan is an element that couple of sites need to think of; Mueller states:

“No, there is no magic ratio to look out for. Also, for a site that’s not enormous, with less than a million pages, maybe, you really don’t need to fret about the crawl spending plan of your site. It’s great to remove unnecessary internal links, but for small to medium-sized websites, that’s more of a website health topic than an SEO one.”

Concern 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a question turns up about no indexed pages that’s somewhat various from the previous two.

The question reads:

“A lot of SEOs are grumbling about having millions of URLs flagged as omitted by noindex in Google Search Console. All to nonsense internal search pages linked from spammy sites. Is this an issue for crawl spending plan?”

Ilyes repeats the earlier point about noindex being a tool for sites to utilize as needed.

Assuming the pages are purposefully noindexed, there’s no need to worry about Search Console flagging them. It doesn’t mean you’re doing anything wrong.

Illyes states:

“Noindex exists to help you keep things out of the index, and it does not come with unintended negative impacts, as we stated formerly. If you wish to make sure that those pages or their URLs, more particularly, don’t end up in Google’s index, continue using noindex and do not fret about crawl spending plan.”

Source: Google