SEO crawlability: structure your site so Google finds every page
Short answer Google finds pages by following links from pages it already knows, so structure is about the path. Keep every page you want found within about three clicks of the home page, link each one from a hub page for its service or topic, and give no page zero links. A free crawler shows each page's click depth.
Want help applying this to your business? Talk it through on a free 30-minute call.
Book a callThe shape that works: home, hubs, detail pages
Picture your site as a tree Google climbs one link at a time. The home page is the trunk. A few hub pages hang off it, one per service or topic. Each detail page hangs off its hub. Google's own guide describes this path: it finds a new page when "a hub page, such as a category page, links to a new blog post" (Google Search Central: How Google Search works).
| Level (clicks from home) | What sits there | Example for a plumber |
|---|---|---|
| 0 | Home page | Home |
| 1 | Hub pages, linked from the main menu | Drains, Water heaters, Service areas, Blog |
| 2 | Detail pages, linked from their hub | Drain cleaning, Sewer camera inspection, Tankless installs |
| 3 | Supporting pages, linked from a detail page or the blog hub | "Why does my drain smell?" post |
The steps below get any site into that shape, whether it sells services, products or advice, and in either country: Google crawls a site in Canada the same way as one in the US.
What is click depth, and how deep is too deep?
Click depth is the number of clicks it takes to reach a page from the home page. Google uses it as a hint of how much a page matters:
"Google can use information such as the number of links it needs to follow to reach a page and the number of links to a page to infer the relative importance of a page over the rest of your site." (Google Search Central: Help Google understand your ecommerce website structure)
Google gives no fixed limit, so the "three-click rule" is a rule of thumb, not a Google rule. The common crawler Screaming Frog flags pages at depth 4 or more by default, counting the home page as 0 (Screaming Frog: Pages With High Crawl Depth). For a site under a few hundred pages, that's a fair target: your money pages at 1 or 2, nothing you care about past 3.
Step 1: Measure click depth for free
- Download Screaming Frog SEO Spider. The free version crawls up to 500 URLs, enough for most small business sites (Screaming Frog pricing).
- Enter your home page address and start the crawl.
- In the Internal tab, sort by the Crawl Depth column. Every page at 4 or more needs a shorter path.
- Write down your 5 to 10 most important pages (the services that pay the bills) and their depth. Any at 3 or deeper should move up.
Then open Search Console's Links report and look at "Top linked pages" under internal links. Google suggests using it to confirm "that users can get from page A to page B with the fewest clicks" and that your "most linked pages are the ones that you expect" (Search Console Help: Links report). If your privacy policy outranks your best service page, your links point the wrong way. See the Search Console guide for the setup.
Step 2: Build hub pages to flatten the tree
A hub page is a page that introduces one topic and links to every page under it, such as "Water heaters" linking to repair, replacement and tankless pages. Hubs are how you keep depth low without stuffing 40 links into the menu.
- One hub per service group, city group or blog topic. Link every hub from the main menu, so hubs sit at depth 1.
- On the hub, link each detail page with plain, descriptive words ("tankless water heater installation"), not "learn more." Google's link guide asks for anchor text that is "descriptive, reasonably concise, and relevant" (Google Search Central: Link best practices).
- Link each detail page back to its hub and to two or three related pages.
- Add a breadcrumb trail (Home > Water heaters > Tankless) to detail pages. Google says it shows "the page's position in the site hierarchy" (Google Search Central: Breadcrumb structured data), and each step is one more link up.
- Link your best page from the home page too. Google says "the more links a page has to it within a site, the higher the relative importance" (Google Search Central: ecommerce site structure).
What a good service hub says beyond its links is covered in on-page SEO for service pages. If you're adding a hub of city pages, check what Google calls doorway pages first.
Step 3: Give every orphan page a link
An orphan page has no links from anywhere on your site, so its click depth is infinite. Google's rule is short:
"Every page you care about should have a link from at least one other page on your site." (Google Search Central: Link best practices)
To find them, compare two lists: the pages you have (your sitemap file, usually yoursite.com/sitemap.xml, or your website builder's page list) and the pages the crawl in Step 1 reached. Any page on the first list but not the second is an orphan. Old landing pages for ads, past promotions and blog posts dropped from the menu are the usual ones. For each, link it from its hub, merge it into a stronger page, or delete it.
Step 4: Use links Google can follow
A link only counts if Google can read it. Google says it can generally crawl a link only when it's a standard HTML anchor element with an href attribute, the part that holds the address (Google Search Central: Link best practices). In plain terms, a normal text or image link with a web address behind it.
| Looks like a link, but Google may miss it | Fix |
|---|---|
| A button or menu item that only runs a script when clicked | Make it a real link to the page's address |
| "Load more" button or endless scroll on a blog or gallery | Add numbered pages, each linking to the next (Google Search Central: Pagination) |
| Image link with no alt text | Add alt text; Google uses it as the link's words (Link best practices) |
| Pages behind a login or a form | Keep anything you want found outside the login |
| Link to a deleted page (error 404) | Point it at the live page; Screaming Frog lists these as Internal Client Error (4XX) |
Run the crawl from Step 1: a page it can't reach through links is a page Google may miss too. Custom code and add-ons such as galleries are the usual suspects.
Step 5: Remove crawl traps
A crawl trap is a set of near-endless addresses that eat Google's visits: filter and sort options, calendars with a "next month" link forever, search result pages. Google says there's "no good reason" to allow crawling of filtered items in most cases, and suggests blocking those parameters in robots.txt; pointing them at the unfiltered page with a canonical tag also works, though Google calls it less effective long term (Google Search Central: Faceted navigation). Most service sites have none. Online stores, real estate listings and event sites often do. Before you block anything, read what robots.txt does and doesn't do.
Step 6: Check that Google found the pages
Give Google time to recrawl, then check each page you moved up with Search Console's URL Inspection tool, which Google points to for seeing "how Google sees your page" (SEO Starter Guide). If a page says "Discovered" or "Crawled, currently not indexed," the fix is often content, not structure: see what those statuses mean.
What doesn't matter much for a small site
- Crawl budget. Google's crawl budget guide is written for sites with 1 million+ pages, or 10,000+ pages that change daily (Google: Crawl budget management).
- A sitemap. Helpful, but Google says a site of "about 500 pages or fewer" that is properly linked might not need one (Google: Learn about sitemaps). Links come first.
- Folder URLs and keywords in them. Grouping pages in folders can help Google learn how often each section changes, but keywords in the URL "have hardly any effect beyond appearing in breadcrumbs" (SEO Starter Guide). Don't rename working URLs just to match the tree.
Example
A plumber with 30 pages
The crawl shows the sewer camera page at depth 4: home, services, drains, blog post, then the page. The owner adds a "Drains" hub to the menu linking all five drain pages. Sewer camera moves to depth 2, along with the other four drain pages.
An accounting firm with an old blog
The firm has 120 blog posts. The blog shows 10 per page behind a "load more" button, so 110 posts are reachable only by script. Switching to numbered pages and adding three topic hubs (bookkeeping, payroll, tax) puts every post at depth 3 or less.
A boutique with 400 products
Filters for size, color and price create thousands of addresses. The owner blocks filter parameters in robots.txt and links every product from its category page. The crawl drops from 6,000 URLs to 450, all of them real pages.
FAQ
What is crawlability in SEO?
It's how easily a search engine can reach your pages by following links. A page Google never reaches can't be indexed or shown in results, however good it is.
Is crawlability the same as indexability?
No. Crawlability is whether Google can reach a page; indexability is whether Google keeps it. A noindex tag or a weak page can stop indexing even when crawling works.
Is there really a three-click rule?
Google never sets one. It says the number of links needed to reach a page is a signal of importance, so shallower is better for pages you care about.
Do footer and menu links count?
Yes, they're normal links. A link inside related text also tells Google what the page is about, so use both.
How often should I check click depth?
After any redesign, menu change or batch of new pages, and otherwise every few months. A free crawl takes minutes on a small site.
Different for you?
- Your site isn't in Google at all: start with the checks in order.
- Traffic fell right after a redesign: see why traffic drops after a redesign.
- You run an online store with categories and filters: read ecommerce SEO.
- You want to see how a competitor structures their site: try a Screaming Frog competitor crawl.
- You'd rather have the structure planned and fixed for you: see the SEO agent.