Products SEO & GEO Agent Paid Ads Agent Website Agent Conversion Agent
How it works Pricing FAQ Blog Book a call

Noindex check: how to see if a page is noindexed

Updated · 6 min read

Short answer Search the page source for "noindex", then check the response headers for an X-Robots-Tag. Either one keeps the page out of Google. To see what Google itself found, paste the address into URL Inspection in Search Console and read "Indexing allowed?". Run the live test there to check today's version, not the last crawl.

Want help applying this to your business? Talk it through on a free 30-minute call.

Book a call

How do I check if a page is noindexed?

Look in two places on the page, then ask Google. Google's Search Central says noindex can be set two ways, a meta tag in the page's code or an HTTP response header, and "They have the same effect." A check that looks at only one of them can miss the other.

CheckWhat it findsTimeYou need
1. View page sourceA noindex meta tag in the code1 minuteAny browser
2. Response headersA noindex sent by the server (X-Robots-Tag)2 minutesChrome or a terminal
3. Browser extensionBoth, on every page you openSeconds, once installedAn extension
4. URL InspectionWhat Google actually saw, and whether it's still there today2 minutesSearch Console access to the site

Checks 1 to 3 tell you what the page says. Check 4 tells you what Google read. When they disagree, Google's answer is the one that decides whether you show up.

Check 1: search the page source for "noindex"

  1. Open the page in your browser.
  2. Right-click an empty spot and choose "View page source". In Chrome you can also type `view-source:` before the address.
  3. Press Ctrl+F (Cmd+F on a Mac) and search for `noindex`.

A blocking tag is a line starting with `meta` that contains `name="robots"` and `content="noindex"`. Read what's around the word before you panic:

  • `name="robots"` applies to every search engine. `name="googlebot"` applies to Google only.
  • `content="none"` also blocks. Google's spec says it equals "noindex, nofollow".
  • `name="googlebot-news"` only affects Google News results.
  • No match at all is good news for this check, but run check 2. The tag can also sit outside the page header: Google says it "will respect robots meta tags in the body section" too.

Check 2: look for an X-Robots-Tag header

A server can send noindex without touching the page's code, in a header named X-Robots-Tag. Headers are the short notes a server sends before the page itself. Google says this is the way to block files that have no code to put a tag in, "such as PDF files, video files, or image files". View source never shows it.

In Chrome:

  1. Right-click the page, choose "Inspect", and open the Network tab.
  2. Reload the page.
  3. Click the first row (the page's own address). In the Headers tab, scroll to Response Headers.
  4. Look for `x-robots-tag`. A value with `noindex` or `none` blocks the page.

If you're comfortable with a terminal, `curl -sI https://example.com/your-page/` prints the same headers in one line. Google treats the header name and values as not case sensitive, so `X-Robots-Tag` and `x-robots-tag` are the same thing.

Check 3: use a browser extension

An SEO extension reads both the tag and the header for every page you open, so you don't have to repeat checks 1 and 2. One example from the Chrome Web Store, Robots Exclusion Checker, flags robots.txt blocks, robots meta tags and X-Robots-Tag headers, and shows the full header. Others do the same job. Extensions are handy for clicking through a site after a redesign, but they report what your browser got, not what Google got.

Check 4: URL Inspection in Search Console

This is Google's own answer. Google's noindex guide says to use it "to see the HTML that Googlebot received while crawling the page."

  1. Open Search Console and paste the full page address into the search bar at the top.
  2. Expand Page indexing and find Indexing allowed?. If it says "No", Search Console help says your site "is returning a "noindex" tag or header".
  3. That first result is the copy Google last crawled, not the live page. Click Test live URL to check the page as it is now.
  4. Click View crawled page (or View tested page in the live test) to see the HTML and HTTP headers Google got.

For many pages at once, the Page indexing report groups every URL Google left out because it found a noindex. There's a daily limit on live tests and indexing requests per site, so use the report for a site-wide picture. For reading that report, see Google Search Console for a small business.

Why do the checks disagree?

What you seeUsual reason
Source is clean, Google says "No"Google's copy is old. The live test shows today's version.
Source is clean, Google says "No" in the live test tooNoindex is in the header (check 2), or a script adds it after the page loads
Source shows noindex, page still in GoogleGoogle hasn't recrawled yet. Google says that "may take months" for some pages.
"Indexing allowed?" says "Yes", but robots.txt blocks the pageGoogle can't read the page, so it can't see the noindex. Search Console help says the field will always be "Yes" in that case.

The script case matters on sites built with JavaScript. View source shows the code before scripts run, so it can miss a tag added later. Google warns the reverse also fails: if the first code it gets says noindex, it "may skip rendering", so a script that removes the tag may never run. Google's advice: "If you do want the page indexed, don't use a noindex tag in the original page code."

Found a noindex you didn't want?

On small business sites it usually comes from a setting, not hand-written code:

Where it comes fromWhere to switch it off
WordPress, whole siteSettings > Reading > "Discourage search engines from indexing this site". WordPress says it adds a noindex, nofollow tag to every page. Often left on after a site launch.
Yoast SEO, one pageIn the page editor, Yoast panel > Advanced > "Allow search engines to show this content in search results" set to "No"
Wix, one pagePages & Menu > More Actions > SEO basics > "Let search engines index this page" turned off
Header (check 2)Server or hosting setup. Ask your web person or host.

After you change it:

  1. Run check 1 or 2 again to confirm the tag is gone.
  2. Run the live test in URL Inspection. "Indexing allowed?" should say "Yes".
  3. Click Request indexing. Search Console help says indexing "typically takes only a day or so" but can take longer, and it isn't guaranteed.

If the page still doesn't show up once noindex is gone, the cause is something else. See crawled or discovered, currently not indexed.

Example

Illustrative cases.

A dentist's new site after launch

Two weeks after launch, no page shows up in Google. View source on the home page shows a robots meta tag with `noindex,nofollow`. The developer left WordPress's "Discourage search engines" box ticked from building. Unticking it, then requesting indexing for the home page and main service pages, starts fixing it.

A roofer's price list PDF

The roofer wants the price list PDF out of Google. View source doesn't apply to a PDF. The web person sets an X-Robots-Tag: noindex header for the file, and check 2 confirms it's in the response.

A landscaper's service page that "came back"

URL Inspection says "Indexing allowed? No" for the lawn care page, but the source is clean. The live test says "Yes": the tag was removed last month and Google's copy is older. Clicking Request indexing is the only step left.

FAQ

Does searching site:mydomain.com tell me if a page is noindexed?

Not reliably. A page can be missing for many reasons, and a noindexed page can linger until Google recrawls it. URL Inspection gives the reason.

Is nofollow the same as noindex?

No. Nofollow is a hint about the links on the page. Noindex keeps the page itself out of results. A tag can carry both.

Does a noindex for Google also block Bing?

Only `name="robots"` addresses every engine; `name="googlebot"` doesn't. Google notes some engines "might interpret the noindex rule differently", so results elsewhere can vary.

Can I put noindex in robots.txt?

No. Google says noindex in the robots.txt file "is not supported". Use the meta tag or the header.

Different for you?

Keep learning

NextCheck for noindex tags across your whole siteA launch, theme or plugin change can hide every page from Google. Find noindex sitewide with Search Console, a free crawl and one header check.

Do it yourself

Crawlability checklist: make every page reachable by GoogleA crawlability checklist for a small business site: find orphan pages, robots.txt blocks, broken links, redirect chains and server errors, with free tools.

Ask us one question

One line is enough. We reply by email.

Sources

  1. Google Search Central: Block Search indexing with noindex
  2. Google Search Central: Robots meta tag, data-nosnippet, and X-Robots-Tag specifications
  3. Google Search Central: Understand the JavaScript SEO basics
  4. Search Console Help: URL Inspection tool
  5. Search Console Help: Page indexing report
  6. Chrome DevTools: Network features reference
  7. WordPress Documentation: Settings Reading Screen
  8. Yoast Help: How to noindex URLs
  9. Wix Help: Preventing Search Engines from Indexing Your Page
  10. Chrome Web Store: Robots Exclusion Checker