Meta robots noindex

highseo-meta-robots

A noindex left in the meta robots tag removes a page from search results entirely, however well-optimized everything else is. How to check it.

What it is

The meta robots tag — <meta name="robots" content="..."> — gives per-page instructions to crawlers, most commonly noindex (don't show this page in search results) and nofollow (don't follow links from this page). This check fails when either is set.

It's a page-level control, distinct from robots.txt, which blocks crawling at the site or path level before a crawler ever reads this tag.

Why it matters

A noindex left on a page — commonly a staging-environment default that never got removed after launch — makes that page invisible to search regardless of how well everything else on it is optimized. It's a high-severity finding because it doesn't degrade a page's SEO, it removes the page from results entirely.

The usual cause is a build or CMS default meant for a staging environment that shipped to production unnoticed; it's worth checking after any deploy pipeline or CMS change, not just once at launch.

How to fix it

with a reference doc
html
<meta name="robots" content="index, follow">

Reference documentation

Related checks

3
highMissing title tagThe <title> tag in a page's <head> names the page for browsers, search results and social shares. It's one of the few pieces of a page search engines still treat as an explicit, author-declared signal rather than something inferred from content.lowCanonical tagA canonical tag (<link rel="canonical">) declares a page's preferred URL when the same content is reachable at more than one address — with and without a trailing slash, with and without a tracking query string, over http and https.mediumAI crawler accessThis reads robots.txt and checks whether it blocks any of the named AI crawlers — OpenAI's GPTBot and OAI-SearchBot, Anthropic's ClaudeBot and Claude-SearchBot, PerplexityBot, Google-Extended, Common Crawl's CCBot and others — distinct from the general-purpose search crawlers (Googlebot, Applebot) that index for classic search.

This is one of the 75 checks the scanner runs. See what we check for the full list, every severity weight, and how the score is computed from them.

See whether your own site passes meta robots noindex.

One page, all 75 checks, free. No account, no card.

Run a scan