SEO

Deindexing

Also called De-indexed, removed from the index

The removal of pages from Google's index — sometimes deliberate, more often an accident involving a noindex tag or a blocked crawl.

Quick facts: Deindexing

Category
SEO
Also called
De-indexed, removed from the index
Level
Intermediate
Affects
Organic visibility, traffic to affected pages, site launches and migrations
Where to see it
Search Console URL Inspection, Page Indexing report, removals tool
In this article4
  1. How deindexing works
  2. Why deindexing matters
  3. Common mistakes with deindexing
  4. What to do about it

How deindexing works

Being in Google’s index is neither automatic nor permanent. A page enters when Google crawls it, decides it is worth storing, and adds it. It leaves when something instructs Google to remove it, or when Google decides on its own that the page no longer earns a place. Once out, the page still exists on your server; it simply cannot appear in results.

Deliberate removal has a few instruments. A noindex tag in the page’s head, or in the HTTP header, tells Google to drop it. A page returning a 404 or 410 status falls out over time. The removals tool in Search Console hides a URL temporarily while you deal with the underlying cause. A canonical tag pointing elsewhere is not a removal instruction at all, but it usually has the same visible effect.

Why deindexing matters

Deliberate deindexing is a normal part of keeping a site tidy. Internal search results, thank-you pages, tag archives, filtered listings and staging copies do not belong in results, and taking them out stops weak pages defining how the whole site looks.

Accidental deindexing is a different matter, and it happens more often than most owners expect. A page that vanishes from the index loses all of its search traffic at once, and the cause is usually invisible from the front end: the site looks perfect to a visitor while a single tag or setting keeps it out of results entirely.

Common mistakes with deindexing

The most frequent by far is a launch that goes live with the staging setting still switched on. WordPress has a tick box asking search engines not to index the site, developers switch it on while building, and nobody switches it off. The site is live, everything works, and nothing ranks.

The second is blocking a page in robots.txt in order to remove it. Blocking stops Google crawling the page, which means it never reads the noindex tag you also added, and the URL can sit in results with no description under it. To remove a page, allow the crawl and use noindex. The third is deleting pages that had links and traffic without redirecting them, which throws away value that took years to earn.

What to do about it

When a page disappears, inspect the URL in Search Console before changing anything. The URL Inspection tool reports whether Google can crawl it, whether it is indexed, and which instruction it found — a noindex, a canonical pointing elsewhere, a block, or a status code the server should not be returning. That single screen usually names the cause.

Then fix at the source and request a recrawl of the page. For a deliberate removal, decide first whether the page should be gone or merely absent from results: a page people should still reach from a link can keep working while carrying noindex, while a page that should not exist at all is better redirected to its replacement. If whole sections keep dropping out, the problem is structural and belongs in a technical SEO review.

Do and do not

Do

  • Inspect the URL in Search Console before changing anything
  • Keep a page crawlable if you want noindex read
  • Redirect deleted pages that carried links or traffic

Do not

  • Block a page in robots.txt to remove it
  • Launch with the staging no-index setting still on
  • Treat the removals tool as a permanent solution

Questions people ask about this

Why has my page disappeared from Google?

Run the URL through the URL Inspection tool in Search Console. It reports whether Google can reach the page, whether it is indexed, and what instruction it found there. The usual causes are a noindex tag, a block in robots.txt, a canonical pointing at another URL, an unintended redirect, or a status code the server should not be returning.

How do I remove a page from Google quickly?

Add a noindex tag and make sure the page can still be crawled, then use the removals tool in Search Console to hide it while that instruction takes effect. The removals tool only hides a URL temporarily, so it is a stopgap rather than a fix. For a page that should not exist at all, remove it and redirect to its replacement.

Does blocking a page in robots.txt remove it from Google?

No, and it often makes things worse. A block stops Google crawling the page, which means it cannot read a noindex tag, so the URL can stay listed with no description beneath it. If you want a page out of results, leave it crawlable and use noindex. Use robots.txt to manage crawling, not indexing.

Related terms

Found this useful?

Share it, or ask an AI to summarise it

Back to the glossary

Knowing the term is the easy part

Applying it to your own site and budget is the work. Book a call and I will tell you what actually applies to you.