SEO

Indexing

Also called Index status, getting indexed

The step where a crawled page is stored in a search engine's database and becomes eligible to appear in results.

Quick facts: Indexing

Category
SEO
Also called
Index status, getting indexed
Level
Beginner
Affects
Whether a page can rank at all, organic traffic, new page launches
Where to see it
Google Search Console (URL Inspection, Pages report), Bing Webmaster Tools
In this article4
  1. How indexing works
  2. Why indexing matters
  3. Where indexing goes wrong
  4. How to act on it

How indexing works

Getting into search results happens in stages, and indexing is the second one. First a search engine has to find and fetch the page, which is crawling. Then it processes what it fetched — reads the text, follows the links, works out the topic, decides whether the page is a duplicate of something it already holds — and, if it judges the page worth keeping, stores a version of it. That stored copy is the index entry. Only after that can the page be considered for any search at all.

None of the stages is guaranteed. A page can be crawled and not indexed, which is the situation that confuses most site owners, because the server logs show Google visited and the page still cannot be found. Indexing is a judgement, not an automatic consequence of publishing, and a search engine will decline to store a page it considers duplicated, empty or not worth the storage.

Why indexing matters

It is the gate everything else stands behind. Keyword work, content, links and speed improvements all assume the page is in the index; if it is not, none of them can produce a single visit. When a new service page brings in nothing at all, the first question is never what it ranks for — it is whether it is indexed.

The reverse matters too. Pages you never intended to be public — internal search results, filtered listings, staging copies, thank-you pages — can be indexed and end up competing with the pages you care about, or showing a stranger a page meant for a customer who has just paid.

Where indexing goes wrong

The blocks fall into two groups. Some are instructions you gave without meaning to: a noindex directive left on after a redesign, a robots.txt rule blocking a whole folder, a canonical tag pointing somewhere else, or the WordPress setting that discourages search engines and stays switched on after launch. These are quick to find and quick to fix.

The others are judgements. Google may report a page as crawled but not indexed, or discovered but not yet crawled, which usually means the page adds nothing to what is already stored, sits with no internal links pointing at it, or belongs to a set of near-identical pages generated automatically. Submitting the URL again does not change that verdict. The page has to become worth indexing.

How to act on it

Check before you speculate. Search Console’s URL Inspection tool tells you whether a specific page is indexed and, if not, which of the reasons above applies; the Pages report groups the same information for the whole site. Read the stated reason first, because the fix for a directive and the fix for a quality judgement have nothing in common.

For directives, remove the block and request indexing once. For judgements, give the page a reason to exist: make it genuinely different from its neighbours, link to it from a page that already gets crawled often, and include it in the XML sitemap. If a large share of a site sits unindexed, the problem is usually structural rather than page by page, and a technical SEO review will find it faster than repeated submissions.

Do and do not

Do

  • Check URL Inspection before assuming a ranking problem
  • Link new pages from pages that already get crawled
  • Keep the XML sitemap limited to indexable pages

Do not

  • Leave noindex or the WordPress discourage setting on after launch
  • Resubmit a page repeatedly instead of improving it
  • Assume indexed means ranking

Questions people ask about this

How long does it take for a new page to be indexed?

There is no fixed wait. A page on a site Google crawls often can appear within a day, while a page on a rarely crawled site can sit for weeks. Publishing it in your sitemap, linking to it from a page that already ranks, and requesting indexing in Search Console all shorten the gap.

My page is crawled but not indexed. What does that mean?

Google fetched the page, assessed it and decided not to store it. That is a quality or duplication judgement rather than a technical error, so resubmitting will not change it. Check whether the page repeats another page on your site, whether anything links to it internally, and whether it genuinely answers a search someone makes.

Does being indexed mean I will rank?

No. Indexing only makes a page eligible to appear; it says nothing about position. A page can be indexed and never surface because stronger pages answer the same query better. Treat indexing as the entry requirement, then judge performance separately using impressions and average position in Search Console.

Related terms

Found this useful?

Share it, or ask an AI to summarise it

Back to the glossary

Knowing the term is the easy part

Applying it to your own site and budget is the work. Book a call and I will tell you what actually applies to you.