Google: Noindexed Pages Do Not Effect Crawl Spending Plan

Posted by

Google’s Browse Relations group validates that noindexed pages don’t negatively impact a website’s crawl budget plan, no matter how many a website has.

This topic is addressed not as soon as but thrice throughout the November 2022 edition of Google’s SEO office-hours Q&A session.

Google Search Supporters John Mueller and Gary Illyes take turns responding to three comparable concerns from people worried they have too many noindexed pages on their websites.

From Mueller’s and Illyes’ reactions, we learn there’s no such thing as “too many” indexed pages. Further, unless your site has over a million pages, there’s no need to worry about crawl spending plan.

Here’s a fast wrap-up of each question and response.

Concern 1: Excessive Indexed Pages

At the 8:23 mark in Google’s November 2022 office-hours, Illyes addresses a question asking if an “extreme” number of indexed pages is an issue for discovery or indexed.

Illyes says noindex is a tool to assist sites keep material out of search engines. Google encourages utilizing the noindex tag when needed, and for that reason, there are no adverse results associated with it.

“Noindex is a really effective tool that online search engine support to help you, this website owner, keep material out of their indexes. For this reason, it does not carry any unintentional effects when it concerns crawling and indexing. For instance, having numerous pages with noindex will not influence how Google crawls and indexes your site.”

Question 2: Ratio Of Indexed/Noindexed Pages

The following question turns up at the 10:22 mark:

“Should we watch on the ratio in between indexed and non-indexed pages in Search Console in order to better recognize possibly wasted crawl budget plan on non-indexed pages?”

Mueller debunks that sites must attempt to stabilize their indexed and nonindexed pages.

To that end, crawl budget is a factor that few websites need to think about; Mueller states:

“No, there is no magic ratio to look out for. Likewise, for a website that’s not massive, with less than a million pages, possibly, you truly don’t need to stress over the crawl spending plan of your website. It’s great to get rid of unnecessary internal links, but for small to medium-sized websites, that’s more of a site hygiene topic than an SEO one.”

Question 3: Noindexed Pages Linked From Spammy Sites

At the 11:26 mark, a concern turns up about no indexed pages that’s a little different from the previous two.

The question checks out:

“A great deal of SEOs are complaining about having millions of URLs flagged as omitted by noindex in Google Browse Console. All to rubbish internal search pages linked from spammy sites. Is this an issue for crawl budget?”

Ilyes repeats the earlier point about noindex being a tool for sites to use as needed.

Assuming the pages are deliberately noindexed, there’s no requirement to stress over Search Console flagging them. It doesn’t indicate you’re doing anything incorrect.

Illyes states:

“Noindex exists to assist you keep things out of the index, and it does not featured unexpected negative effects, as we stated formerly. If you want to guarantee that those pages or their URLs, more specifically, don’t end up in Google’s index, continue using noindex and do not fret about crawl spending plan.”

Source: Google