Visualize website structure in Screaming Frog: read the diagrams
Short answer Crawl your site in Screaming Frog (free up to 500 URLs), open Visualisations, and read three things: how many rings out your key pages sit, where red non-indexable clusters gather, and which pages get few links. Screaming Frog flags depth 4 or more by default. A link crawl can't draw orphan pages; finding them needs a sitemap or Search Console check.
Want help applying this to your business? Talk it through on a free 30-minute call.
Book a callWhat to look for in a Screaming Frog crawl diagram
Three patterns: pages sitting too far from the homepage, clusters of red dots, and pages with few links pointing in. Each one points to a different fix.
| Pattern in the diagram | Where to confirm it | Usual fix |
|---|---|---|
| A key service page four or more rings out | Links tab, "Pages With High Crawl Depth" filter | Link it from the menu, homepage or a top service page |
| A clump of red dots | Directory tree diagram; Site Structure tab | Remove a stray noindex tag, fix redirects or broken pages |
| A page you know exists is missing | Not in the diagram at all: check outside it | Add a normal text link to it |
| A key page drawn small when sized by inlinks | Internal tab, "Unique Inlinks" and "Link Score" columns | Add links from related pages |
Screaming Frog's own guide warns that the pictures "don't provide any more data than is already available in a crawl." Use the diagram to spot the pattern, then use the tabs to get the list of pages to fix. If you haven't made a diagram yet, or are choosing a tool, start with site structure visualization.
Crawl diagram or directory tree: which one to open?
Open the crawl diagram for "how hard is this page to reach?" and the directory tree for "is a whole section broken?" They answer different questions (Screaming Frog: Visualisations guide):
- Crawl diagrams (Force-Directed Crawl Diagram, 3D version, Crawl Tree Graph) place each page by its crawl depth: the number of clicks from your homepage. Each line is the shortest link path to that page, not every link.
- Directory tree diagrams group pages by the folders in their web address (/services/, /blog/). Lines are not links. Pages in one folder usually share one page template, so a template-wide mistake shows up as one red block here, while in the crawl diagram the same pages are scattered.
Both are in the Visualisations menu of the free version, which crawls up to 500 URLs. The paid licence is £199 a year; the US-dollar price shown in November 2026 was $279, with no Canadian-dollar price listed (Screaming Frog: pricing).
How to spot pages that are too deep
Count rings. The homepage is the large, dark green dot in the middle; each ring out is one more click, and dots get smaller and lighter as they go (Screaming Frog: Visualisations guide).
Then confirm with numbers, because a picture of 400 dots is hard to count:
- Open the Site Structure tab on the right. Its lower chart shows how many URLs sit at each depth, from 1 to 10+.
- Run Crawl Analysis > Start, then open the Links tab and pick the Pages With High Crawl Depth filter. By default it lists pages at depth 4 or more, with the start page counted as 0. You can change that number under Config > Spider > Preferences (Screaming Frog: Pages With High Crawl Depth).
- Export the list and mark the pages that earn you money.
Don't flatten everything. Screaming Frog's own note says unimportant pages, or pages on large sites, "will often naturally sit deeper without issue." Google sets no click limit either. Its rule is that a page can be reached:
"Every page you care about should have a link from at least one other page on your site." (Google Search Central: Link best practices for Google)
So the test is narrow: is a page that brings you customers buried? A plumber's emergency repair page at depth 4 is a problem; a 2019 blog post at depth 6 usually isn't.
One quirk: Screaming Frog counts a redirect as a level of depth (user guide: Tabs). A page that looks five clicks deep may be three clicks plus two redirects. Pointing old links straight at the final address fixes both.
How to spot messy or broken sections
Look for color. Green dots are pages Google may index; pastel red ones are non-indexable, for example a noindex tag (a line asking search engines to leave the page out), a redirect or an error. The "i" icon on the diagram shows the full color key (Screaming Frog: Visualisations guide).
- A red block in the directory tree means a whole folder shares the problem, usually through one template or one setting. A gallery or locations folder left on noindex after a site build is a common case.
- Red dots scattered through the crawl diagram usually mean individual broken or redirected links. Check the pages linking to them.
- The Site Structure tab gives the same picture as a table: each folder with its count of indexable and non-indexable URLs.
Some red is fine: thank-you pages, logins and author archives are often kept out of search on purpose. Ask "did we mean this?" before fixing anything.
How to see which pages get the most links
Change what sets the size of each dot. Click the cog on a force-directed diagram and scale the nodes by unique inlinks (how many different pages link to it) or Link Score (Screaming Frog's 0–100 estimate of a page's internal link strength, similar to Google's PageRank). Link Score fills in only after Crawl Analysis runs (Screaming Frog: Visualisations guide; user guide: Tabs).
What you want: your main service pages among the biggest dots. If the contact page and an old blog post are huge while "roof replacement" is a speck, your links point at the wrong pages. See internal links to money pages.
To see every link to one page, not just the shortest path, right-click its dot and choose Show Inlinks. Linking pages turn green and the rest fade to grey.
Why orphan pages don't show up in the diagram
An orphan page is one nothing on your site links to. A crawler finds pages by following links, so it can't draw a page it never reached. An empty spot is invisible.
Screaming Frog finds orphans only by comparing the crawl with another list (user guide: Tabs):
| Other list | Filter | Licence needed? |
|---|---|---|
| Your XML sitemap | Sitemaps tab, "Orphan URLs" | Paid (crawl configuration) |
| Google Search Console | Search Console tab, "Orphan URLs" | Paid (integration) |
| Google Analytics | Analytics tab, "Orphan URLs" | Paid (integration) |
Each also needs Crawl Analysis run after the crawl. The free route: export the crawl's Internal tab and compare it with the page list in your website builder (WordPress, Wix, Squarespace). Any page in the builder but not the crawl is an orphan or blocked. Full steps are in orphan pages.
Also check that your links are real links. Google says it can generally crawl a link only if it is a standard HTML link (an "a" element with an "href" address) (Google Search Central: Link best practices). A menu built only from script buttons can make a whole section look orphaned to both Screaming Frog and Google.
Large sites: when the diagram gets too big
The 2D diagrams show up to 10,000 URLs at a time; grey dots mean children were cut off. Right-click and choose Focus or Explore to open that branch. The 3D diagram opens in your web browser and handles up to 100,000 URLs (Screaming Frog: Visualisations guide). Most small business sites never hit either limit. Past 500 URLs, though, the free version stops crawling.
To share the result, click the save icon and pick HTML (interactive, opens in any browser) or SVG (a still image). Your web designer can open the HTML file without Screaming Frog.
Example
Illustrative cases with invented numbers.
A roofer with a buried money page (US dollars)
A 90-page site. The crawl diagram shows "roof replacement" five rings out. The High Crawl Depth filter confirms depth 5: two of those clicks are redirects from an old /services/ address. The roofer points the menu link straight at the new page and adds it to the homepage. Depth drops to 1. Cost: $0, free version.
A Calgary physiotherapy clinic with a red folder
The directory tree shows all 25 pages under /conditions/ in red. One template carries a noindex tag left from the site's build. Removing it turns the folder green on the next crawl.
A Toronto accountant with lopsided links
Sized by unique inlinks, the biggest dot after the homepage is a 2021 tax deadline post linked from every sidebar. "Small business bookkeeping" is tiny. The accountant swaps the sidebar link to the bookkeeping page. No licence needed.
FAQ
How many clicks deep is too deep?
Google publishes no number. Screaming Frog flags depth 4 or more by default. Aim to keep pages that bring customers within one or two clicks of the homepage.
Is the free version of Screaming Frog enough for this?
For sites up to 500 URLs, yes: diagrams, depth, colors and inlink sizing all work. Finding orphan pages through your sitemap, Search Console or Analytics needs the paid licence.
Why does my diagram show fewer pages than my site has?
The crawler reached only linked pages, the crawl stopped at the 500-URL limit, or robots.txt blocked a section. Missing pages are worth checking one by one.
How often should I re-check the diagram?
After any redesign, menu change or batch of new pages. A quiet site can wait a few months.
Different for you?
- You haven't picked a tool or made your first map: site structure visualization.
- Pages are missing from the crawl: orphan pages.
- You need a plan for which pages link where: internal linking strategy.
- Your money pages get too few links: internal links to money pages.
- You're rebuilding the site's layout: technical SEO site structure.
- You'd rather have the structure checked and fixed for you: SEO & GEO Agent.