Crawl Depth

Crawl depth means two things — the click depth of a page (clicks from the homepage) and a crawler's depth-limit setting. Why depth comes from internal links not URL slashes, whether the "3-click rule" is real, and how to measure and reduce it.

First published: Jun 22, 2026 · Last updated: Jul 18, 2026 · Advanced
demand #12 in Website Structure#132 in Technical SEO#181 on the site

Crawl depth is used two ways: a page's click depth (how many clicks from the homepage to reach it) and a crawler's depth-limit setting (how many levels deep a crawl goes before it stops). Depth is defined by internal links, not URL folders — Mueller: 'we don't count slashes in the URLs.' Pages close to the homepage are discovered faster, crawled more often, and read as more important. The '3-click rule' is folklore: Bing names three clicks, Google never has, and UX research finds the count alone doesn't predict success. Reduce depth with internal links, hub pages, and tidy navigation — but don't flatten everything, or Google reads it all as equally important.

TL;DR —Crawl depthCrawl depth usually means click depth — how many clicks it takes to reach a page from the homepage by following internal links. It can also mean a crawler setting that limits how many levels deep a crawl goes before it stops.” conflates two things: a page’s click depth (clicks from the homepage following internal linksAn internal link is a hyperlink from one page on a website to another page on the same website. Internal links help search engines discover your pages and pass ranking signals (PageRank and anchor-text context) between them.) and a crawlerA crawler — also called a spider or bot — is an automated program that fetches web pages, extracts their links, and queues new URLs to visit. Search engines use crawlers to discover and download content for their index. depth-limit setting (how many levels a crawl traverses before stopping). Depth is defined by links, not URL folders — Mueller: “From our point of view we don’t count slashes in the URLs.” Shallow pages are discovered, crawled, and weighted as more important; deep/orphan pagesAn orphan page is a page on your site that no other page links to internally. Because crawlers discover pages by following links, an orphan page is effectively invisible to search engines unless it's in an XML sitemap or linked from an external site. aren’t. The “3-click rule” is folklore — Bing names three, Google names none, NN/g foundA 302 (\"Found\") is a temporary redirect: it forwards users to a new URL while telling search engines the original URL should stay in the index. It's a weak canonicalization signal, not the zero-equity dead end of SEO folklore. the count alone doesn’t predict success. Aim for a pyramid: important pages shallow, but don’t flatten everything (Mueller: then “we think, oh all of these are equally important”). Reduce depth with internal links, hubs, breadcrumbsBreadcrumbs are a secondary navigation trail (Home > Category > Page) that shows where a page sits in a site's hierarchy. They create internal links that pass PageRank, and when marked up with BreadcrumbList structured data they can drive the path Google shows in desktop search results., and cleaner nav; watch redirectsA redirect sends browsers and crawlers from a requested URL to a different one. An HTTP redirect specifically is a 3xx status code paired with a Location header; meta refresh and JavaScript redirects achieve a similar navigation without being a 3xx response themselves. Permanent redirects (301/308) are Google's signal the target should be canonical; temporary ones (302/303/307) aren't. and JS-only links that inflate effective depth.

Two meanings, defined separately

The term is used two ways, and most articles quietly switch between them. Pin them down first:

  1. Click depth (page depth). The number of clicks to reach a page from the homepage — or from the crawl’s start URL — following internal linksAn internal link is a hyperlink from one page on a website to another page on the same website. Internal links help search engines discover your pages and pass ranking signals (PageRank and anchor-text context) between them.. Homepage is depth 0; a page linked from the homepage/nav/footer is depth 1. This is a property of an individual page describing how buried it is. It’s what Screaming Frog’s “Crawl Depth” column and Ahrefs Site Audit’s “Depth” report.

  2. Crawl depth as a crawlerA crawler — also called a spider or bot — is an automated program that fetches web pages, extracts their links, and queues new URLs to visit. Search engines use crawlers to discover and download content for their index. setting. A configurable limit on how many levels deep a crawler follows links before it stops. In Ahrefs Site Audit this is the “maximum click depth” — set it to 4 and pages that can’t be reached within four clicks won’t be crawled at all.

The two interlock: a page’s click depth determines whether a depth-limited crawl ever reaches it, and a deeper page is generally discovered less reliably and crawled less often.

Precisely, a page’s click depth is the length of the shortest path from your crawl’s chosen start URL to that page, through links the crawler counts as crawlable. That makes depth relative to whatever you seed the crawl with — start from the homepage and you get homepage-relative depth; add sitemapA sitemap is a file that lists the pages, images, videos, and other files on your site so search engines can discover them. It helps discovery, but submitting a sitemap doesn't guarantee crawling or indexing. URLs, a URL list, or other seeds, and the numbers stop being comparable to a homepage-only crawl. State what you seeded from before you compare depth numbers.

This is the most common confusion, so it’s worth stating bluntly. Depth comes from the link path, not the URL string. Mueller, in a 2018 Webmaster Central hangout:

“From our point of view we don’t count slashes in the URLs.”

A page at /a/b/c/d/page/ that’s linked from the homepage is depth 1. A page at /page/ that’s six clicks down the link graph is depth 6. Google’s own URL-structure guidance asks you to keep URLs logical and readable — but it never equates folder depth with click depth. So don’t flatten your folder structure to “reduce depth”; change where pages are linked from. Evidence for this claim Google's URL guidance addresses logical, descriptive URL structure but does not equate folder count with click depth. Scope: Google URL structure guidance. Confidence: high · Verified: Google: URL structure best practices

A corollary: Google only follows links it can see. Per Search Central, “Google can only crawl your link if it’s an <a> HTML element with an href attribute.” A “link” that’s really an onclick handler or a <button> with no href may not be followed — so a page you think is one click deep via a JavaScript menu can be far deeper (or undiscoverable) in practice. The same goes for template and device variants: a desktop mega-menu and a collapsed mobile nav don’t always expose the same links, so a depth audit should say which rendered version — and which device — it measured. In my How Search Works talk I make the same point about Google’s link parsing missing JS-driven navigation; it’s a real way to accidentally inflate effective depth. Evidence for this claim Google recommends crawlable anchor elements with href attributes and says every important page should be linked from another page. Scope: Google link discovery; it does not establish a universal click-depth threshold. Confidence: high · Verified: Google: Link best practices

Why crawl depth matters for SEO

Five reasons, roughly in order of how concrete they are:

  • Discovery. Crawlers find pages by extracting links. A deep page is found later; an orphan (no internal links) may never be found. Google’s link guidance is blunt about the fix: “Every page you care about should have a link from at least one other page on your site.”
  • Crawl frequencyCrawl frequency is how often a search engine comes back to re-fetch a page it already knows about. Popular pages that change often get refreshed many times a day; stable pages can go weeks or months between crawls — and you influence it indirectly, not by setting a dial.. Pages closer to the homepage tend to be crawled more often. Depth feeds into how a crawler prioritizes, which ties into crawl budgetThe number of URLs an engine will crawl in a timeframe. — though for most sites that budget isn’t a constraint to begin with.
  • Importance signal. Google infers importance from proximity to the homepage. Mueller: “What does matter for us a little bit is how easy it is to actually find the content.” If something is one click from home, that’s a vote for its importance.
  • Link equity. PageRankPageRank is Google's original recursive link-graph algorithm: a page's score depends on the scores of the pages linking to it, and in the published model each page's score is split across its outbound links (the simplified version: links are weighted votes). Google says it's evolved since launch but still part of its core ranking systems. flows through internal links. Shallow, well-linked pages accumulate more of it; pages stranded at the bottom of the graph get less.
  • User experience. People also find things faster when they aren’t ten clicks deep. The SEO and UX cases point the same direction here.

A useful framing from my own Beginner’s Guide to Technical SEO: “Internal links are links from one page on your site to another page on your site. They help your pages be found and also help the pages rank better.” Crawl depth is just the architectural expression of that.

Is the “3-click rule” real?

Short version: no — not as a Google rule.

The “everything within three clicks” idea is a UX rule of thumb (it traces back to the early 2000s), and it’s intuitive enough that it became SEO gospel. But:

  • Google has never named a number. There’s no Google statement of a click-count threshold. What Google says is about reachability and importance, not “three.”
  • Bing does name three. Bing’s webmaster guidance recommends a broad-to-specific structure so important pages are reachable, in their phrasing, “ideally within three clicks from the homepage.” So if you’ve heard “three clicks” attached to a search engine, it’s Bing, not Google.
  • UX research doesn’t back the rule either. Nielsen Norman Group tested it and concluded “user dropoff does not increase when the task involves more than 3 clicks, nor does satisfaction decrease.” The number of clicks alone doesn’t predict whether people succeed; clarity of the path matters more.

So the honest framing: keep important pages shallow because it helps discovery, crawl frequencyCrawl frequency is how often a search engine comes back to re-fetch a page it already knows about. Popular pages that change often get refreshed many times a day; stable pages can go weeks or months between crawls — and you influence it indirectly, not by setting a dial., and importance signals — not because three is a magic threshold. Treat a three- or four-click threshold as a triage heuristic — a fast way to flag important pages that might be under-linked — not a pass/fail test to apply uniformly across every URL on the site.

A note on a stat you’ll see floating around. A claim that “94% of top pages are within 3 clicks” (and that anything past five clicks is an orphan) gets repeated on a lot of SEO blogs. I couldn’t find a primary source for it, and it appears to be a garbled echo of an unrelated Ahrefs figure. I’m leaving it out rather than repeat an unsourced number.

Flat vs. deep vs. pyramid

It’s tempting to “fix” depth by flattening everything — linking thousands of pages from the homepage so nothing is far away. Don’t. Mueller’s warning about overly flat architectures: “Whereas if it’s very flat, then we think, oh all of these are equally important.” If everything is one click from home, you’ve thrown away the hierarchy Google uses to understand what’s important.

The other extreme is just as bad — burying content so deep that, in Mueller’s words, “you don’t want it to be such that it’s like you have to click through a million times to actually get to the actual content.”

His recommendation is the middle path: “So from my point of view, I think for a lot of sites it makes sense to have more of a pyramid structure.” Homepage at the top, broad category/hub pages a click down, specific pages below those. Important pages sit a few clicks from home; the hierarchy still communicates relative importance.

How to check crawl depth

Every serious crawler reports depth; the gotchas are in how they compute it.

  • Screaming Frog SEO Spider. The “Crawl Depth” column is clicks from the start URL (depth 0). It flags pages with high crawl depth as an issue. Watch two things: the start URL is depth 0 (crawl from the homepage if you want homepage-relative depth), and a redirect counts as a hop — a page reached via a 301 reads one level deeper than the same page linked directly.
  • Ahrefs Site Audit. Reports each page’s Depth, and the maximum click depth setting controls how deep the crawl itself goes. If you cap it, you’ve also capped the depth numbers you’ll see — a page beyond the cap shows as uncrawled, not as “very deep.”
  • Semrush / Sitebulb. Both expose a crawl-depth metric and depth-based reports for the same purpose.

A useful audit doesn’t stop at “what’s the deepest page.” Bucket every page you care about by depth and by template, so a handful of intentionally deep pages don’t hide a widespread architecture problem — or a single outlier doesn’t make the whole site look worse than it is.

The general gotchas: the start URL changes every number; redirect chainsA → B → C instead of A → C. Each hop loses link equity and adds latency. add hops; JS-only links can hide the real path; the render mode and device you crawl with (JS-rendered vs. raw HTML, desktop vs. mobile nav) can expose a different link graph entirely; and the crawler’s own depth-limit setting can artificially cap reported depth — pages beyond that cap show up as uncrawled, not as proven to sit at any particular depth. Two tools can disagree on the same site purely because of these settings.

For the ground truth on what bots actually reached — versus what a simulated crawl predicts — server-side log file analysisLog file analysis is reading a web server's raw access logs to see exactly which URLs search engine crawlers actually requested, when, how often, and what status code they got. Unlike crawl tools or Search Console, logs are the unsampled, ground-truth record of what really happened. is the complement to a depth audit.

How to reduce crawl depth

In rough priority order:

  • Add internal links from shallow, authoritative pages. A contextual link from a high-traffic, low-depth page is the most direct way to pull a deep page up.
  • Use hub / category pages. A well-organized hub linking to its cluster keeps every member of that cluster a click or two from the hub (and the hub a click from home).
  • Tidy navigation, footer, and breadcrumbsBreadcrumbs are a secondary navigation trail (Home > Category > Page) that shows where a page sits in a site's hierarchy. They create internal links that pass PageRank, and when marked up with BreadcrumbList structured data they can drive the path Google shows in desktop search results.. These are site-wide links; what you put in them defines the shallow layer. Breadcrumbs also create consistent upward link paths.
  • Fix orphan pagesAn orphan page is a page on your site that no other page links to internally. Because crawlers discover pages by following links, an orphan page is effectively invisible to search engines unless it's in an XML sitemap or linked from an external site.. Give every page you care about at least one internal link.
  • Handle paginationPagination splits a large set of content — product listings, blog archives, search results — across multiple sequentially numbered URLs. For SEO, each paginated page should be crawlable, indexable, and self-canonical; Google no longer uses rel=prev/next, but Bing still does. and faceted navigationFaceted navigation (faceted search, product filtering) lets visitors refine a list of products or content by attribute — price, color, size, brand, rating. The SEO problem: each filter combination can spawn a distinct crawlable URL, turning a small catalog into millions of near-duplicate pages that waste crawl budget and dilute ranking signals.. Deep paginated archives and facet combinations are the classic way products end up eight clicks deep. Favor “view all” or hub pages over forcing crawlers through endless “next” links, and don’t hide the real path behind load-more JavaScript.
  • Fix redirect chains. Each hop in a chain adds a level; collapsing chains to a single 301 removes the extra depth.
  • Add an HTML sitemapA sitemap is a file that lists the pages, images, videos, and other files on your site so search engines can discover them. It helps discovery, but submitting a sitemap doesn't guarantee crawling or indexing. for very large sites as a supplementary shallow path.

And the counterweight: don’t over-flatten. The goal is important pages within a few clicks, not everything one click from home. As crawl efficiency goes, you raise discovery far more by removing waste and linking smartly than by trying to make the whole site one level deep.

If you’re testing a depth change — a new hub, a nav restructure — measure it properly. Crawl before and after with the same configuration (same seed, render mode, and depth cap) so the numbers are actually comparable, decide up front which pages and templates you expect to move, and give it a defined window. Then look at crawlingCrawling is how search engines use automated bots (like Googlebot and Bingbot) to discover URLs and download pages. A page has to be crawlable to be indexed, but crawling on its own isn't a ranking factor., indexingStoring a crawled page in the search index so it can appear in results. Crawled is not the same as indexed — Google selects what to keep, and indexing isn't guaranteed., and rankings as separate outcomes: a shallower path doesn’t guarantee any of them moves, and a traffic change in that window isn’t proof the depth change caused it.

When crawl depth matters most

Depth is a bigger deal on:

  • Large sites and e-commerce with deep faceted catalogs, where products can sink many clicks deep.
  • News and archive sites where pagination pushes older content down.
  • New sites, where discovery is the bottleneck and you can’t afford pages that aren’t reachable.

These are the same conditions where crawl budgetThe number of URLs an engine will crawl in a timeframe. starts to matter — the two are related but distinct: depth is about a single page’s distance and discoverability, while crawl budget is the broader rate-and-demand envelope. As I cover in my crawl budget guide, most sites never need to worry about budget at all; depth, though, is worth a quick audit on almost any site.

Add an expert note

Pin an expert quote

New person? Create their unclaimed profile at /admin/experts/ → Pin a quote first.