Discovered, currently not indexed: get Google to crawl your pages
Short answer When a large share of your pages sit in Discovered - currently not indexed, fix the site, not each page. Keep the server fast and error-free, cut URLs you don't need crawled, link new pages from pages Google already visits, keep the sitemap clean, publish in smaller batches, then wait. Request indexing only for a few key pages.
Want help applying this to your business? Talk it through on a free 30-minute call.
Book a callDiscovered, currently not indexed on many pages: the fix
Google knows the addresses but hasn't visited them yet. Its description of the status:
"The page was found by Google, but not crawled yet. Typically, Google wanted to crawl the URL but this was expected to overload the site; therefore Google rescheduled the crawl." (Search Console Help: Page indexing report)
When it's a few pages, wait. When it's hundreds, or most of your site, Google's advanced crawling guide names you as its audience: "Sites with a large portion of their total URLs classified by Search Console as Discovered - currently not indexed" (Google: Crawl budget management). Crawl budget is how many pages Google is willing and able to fetch from your site in a given time. The steps below come from that guide.
Is it one page or a site-wide problem?
| What you see | What it usually means | What to do |
|---|---|---|
| A few pages published in the last two weeks | Normal queue. "It can take a week or so" for a new page or site (Search Console Help) | Wait |
| One important page stuck for weeks | A page-level problem | Follow our guide to single pages not indexed |
| Hundreds of pages, or most of the site | Server limits, too many junk URLs, or both | Steps 1–7 below |
Step 1: Find the pattern in the list
In Search Console, open Indexing, then Pages, and click Discovered - currently not indexed. Sort the example addresses into groups by folder or ending: `/tag/`, `/page/2/`, `?sort=price`, product variants, location pages. If most are addresses you never wanted in search, your good pages are stuck behind junk. If they're your real pages, look at the server (step 2) and links (step 4) first.
Step 2: Check whether your server is the bottleneck
Google starts every site at "the same default, conservative crawl capacity limit" and raises it only while the site stays healthy (Google: Crawl budget management). It lowers the limit when your site struggles:
"If the site slows down (latency increases or response times become longer), or responds with server errors (5xx HTTP status codes) or rate-limiting signals (such as HTTP 429), the limit goes down and Google crawls less." (same page)
A 5xx error means the server failed; 429 means "too many requests". Google says a significant number of 500, 503 or 429 replies slows crawling "across the whole hostname", good pages included (Google Crawling Infrastructure: Reduce Google crawl rate).
What to check:
- Run URL Inspection on a stuck page and click Test live URL. If it reports Hostload exceeded, Google's fix is to "add more server resources if that makes sense for your business" (Google: Crawl budget management).
- Ask your host whether your plan or a security setting limits bots or returns 429s at busy times.
- Make pages load faster. Google says if it "can load and render your pages faster, we might be able to read more content from your site" (same page).
Step 3: Cut the URLs Google shouldn't spend time on
Google tries to crawl every address it knows. Wasting that time on duplicates and junk is, in its words, "the factor that you can positively control the most" (Google: Crawl budget management).
| URL type | Example | Fix |
|---|---|---|
| Filter and sort links | `/shoes?color=red&sort=price` | Block them in robots.txt; Google warns they "can generate infinite URL spaces" (Google: Faceted navigation) |
| Same content at many addresses | Print versions, tracking-code copies | Merge to one address (Google: Crawl budget management) |
| Soft 404s: empty pages that load as normal | "No results" search pages | Return a real 404. Soft 404s "will continue to be crawled, and waste your budget" (same page) |
| Removed pages | Sold-out products, old promotions | 404 or 410. A 404 "is a strong signal not to crawl that URL again" (same page) |
| Redirect chains | A → B → C | Point A straight to C. Long chains "have a negative effect on crawling" (same page) |
| Near-identical template pages | 300 city pages with a swapped town name | Merge into fewer, real pages; see city pages and doorway pages |
Two traps:
- Noindex doesn't save crawling. "Don't use noindex, as Google will still request, but then drop the page" (same page). It's for keeping a page out of results, not for freeing crawl time.
- Robots.txt isn't a temporary switch. Use it only for pages you never want crawled. Google says it "won't shift this newly available crawl budget to other pages" unless it was already hitting your server's limit (same page).
Step 4: Link new pages from pages Google already crawls
Google finds new pages mostly through links. Its example: "a hub page, such as a category page, links to a new blog post" (Google Search Central: How Google Search works). So link each new page from your home page, a menu, or a category or service page that is already indexed.
Make the link a real one. Google "can only crawl your link if it's an" HTML anchor element "with an href attribute": a normal link, coded as `a href` (Google Search Central: Link best practices). Pages reachable only through a "Load more" button run by a script may not be found; Google says it "can't reliably extract" such links (same page).
Step 5: Keep the sitemap to pages you want indexed
A sitemap is a file that lists your pages for search engines. List only live pages you want in search, each at its final address.
- Date honestly. Google uses the last-modified date only "if it's consistently and verifiably ... accurate" (Google Search Central: Build and submit a sitemap). A copyright-year change doesn't count as an update (same page). Stamping every page with today's date teaches Google to ignore it.
- Submit it in Search Console's Sitemaps report, which shows when Googlebot last read it (same page). Submitting is "merely a hint" (same page).
- Skip priority and change frequency. Google says it ignores both (same page).
Step 6: Publish in smaller batches
Crawl limits grow with time and trust. Google raises a site's limit "over time" if there is demand and the site stays healthy, and weighs "popularity, overall user value, content uniqueness, and serving capacity" (Google: Crawl budget management). A new site that adds 1,000 template pages in a day is asking more than its starting limit allows. Release pages in batches, best first, and add the next batch once most of the last one is indexed.
Step 7: Request indexing for a few key pages, then wait
In URL Inspection, click Request indexing for your most important stuck pages only. There is "a quota for submitting individual URLs", and a request "does not guarantee" inclusion (Google Search Central: Ask Google to recrawl). Google puts crawling at a few days to a few weeks (same page). Then watch the Discovered count in the Pages report fall. You don't need to click Validate Fix: Google updates the count whenever it recrawls (Search Console Help).
What doesn't help
| Advice you'll see | Why to skip it |
|---|---|
| Google's Indexing API or a paid "instant indexing" service | The API "can only be used to crawl pages with either JobPosting or BroadcastEvent embedded in a VideoObject" (Google Search Central) |
| Adding schema markup | Google reads markup only after it fetches the page, so it can't move a page up the queue |
| Google's Mobile-Friendly Test | Retired on December 1, 2023 (Google Search Central Blog) |
| Dynamic rendering (a bot-only version of your pages) | Google calls it "a workaround and not a recommended solution" (Google Search Central) |
| Clicking Request indexing for every page | The quota runs out; it doesn't fix the cause |
Example
An online shop with 40,000 Discovered URLs
The store has 800 products. The list is full of `?size=`, `?color=` and `?sort=` addresses. Fix: block the filter parameters in robots.txt, keep product and category pages in the sitemap, and give each product one address. The real product pages get crawled once the filter copies stop eating the time.
A cleaning company that published 250 area pages at once
Each page has the same text with a new town name. Only the 10 linked from the menu got crawled. Fix: merge into 12 area pages with local jobs and photos, link all 12 from the service-area page, redirect the rest, and add new areas a few at a time.
A law firm blog on cheap shared hosting
200 articles sit in Discovered. URL Inspection shows Hostload exceeded, and the host confirms the site returns 503s at busy times. Fix: move to a stronger plan, then request indexing for the five main practice-area pages and wait two to three weeks.
FAQ
How long does Discovered, currently not indexed last?
There's no fixed limit. Google says a new page or site can take "a week or so" to start (Search Console Help), and crawling can take days to weeks. If it lasts a month or more on many pages, work through the steps above.
Does Discovered mean my content is low quality?
Not by itself: Google hasn't read the page yet, and its own description blames expected server overload. Site-wide quality still matters, because Google weighs user value and uniqueness when deciding how much to crawl.
Should I delete pages stuck in Discovered?
Only the ones you don't need in search. Returning a 404 tells Google to stop requesting them, which frees time for the rest.
My site has under 500 pages. Does any of this apply?
Rarely. Google says sites under 500 pages "probably don't need" the Page indexing report (Search Console Help). Check that your home page and main service pages are indexed and stop there.
Different for you?
- Only one or two key pages are missing: crawled or discovered, currently not indexed.
- Your whole site is missing from Google: website not showing up on Google.
- You run an online store with filters: ecommerce SEO.
- You want a monthly Search Console habit: the reports to read.
- You'd rather have someone sort it: SEO & GEO Agent.