Crawl Depth

Crawl depth means two things — the click depth of a page (clicks from the homepage) and a crawler's depth-limit setting. Why depth comes from internal links not URL slashes, whether the "3-click rule" is real, and how to measure and reduce it.

First published: Jun 22, 2026 · Last updated: Jul 18, 2026 · Advanced
demand #15 in Website Structure#219 in Technical SEO#302 on the site

Crawl depth is used two ways: a page's click depth (how many clicks from the homepage to reach it) and a crawler's depth-limit setting (how many levels deep a crawl goes before it stops). Depth is defined by internal links, not URL folders — Mueller: 'we don't count slashes in the URLs.' Pages close to the homepage are discovered faster, crawled more often, and read as more important. The '3-click rule' is folklore: Bing names three clicks, Google never has, and UX research finds the count alone doesn't predict success. Reduce depth with internal links, hub pages, and tidy navigation — but don't flatten everything, or Google reads it all as equally important.

TL;DR — “Crawl depth” conflates two things: a page’s click depth (clicks from the homepage following internal links) and a crawler depth-limit setting (how many levels a crawl traverses before stopping). Depth is defined by links, not URL folders — Mueller: “From our point of view we don’t count slashes in the URLs.” Shallow pages are discovered, crawled, and weighted as more important; deep/orphan pages aren’t. The “3-click rule” is folklore — Bing names three, Google names none, NN/g found the count alone doesn’t predict success. Aim for a pyramid: important pages shallow, but don’t flatten everything (Mueller: then “we think, oh all of these are equally important”). Reduce depth with internal links, hubs, breadcrumbs, and cleaner nav; watch redirects and JS-only links that inflate effective depth.

Two meanings, defined separately

The term is used two ways, and most articles quietly switch between them. Pin them down first:

  1. Click depth (page depth). The number of clicks to reach a page from the homepage — or from the crawl’s start URL — following internal links. Homepage is depth 0; a page linked from the homepage/nav/footer is depth 1. This is a property of an individual page describing how buried it is. It’s what Screaming Frog’s “Crawl Depth” column and Ahrefs Site Audit’s “Depth” report.

  2. Crawl depth as a crawler setting. A configurable limit on how many levels deep a crawler follows links before it stops. In Ahrefs Site Audit this is the “maximum click depth” — set it to 4 and pages that can’t be reached within four clicks won’t be crawled at all.

The two interlock: a page’s click depth determines whether a depth-limited crawl ever reaches it, and a deeper page is generally discovered less reliably and crawled less often.

Precisely, a page’s click depth is the length of the shortest path from your crawl’s chosen start URL to that page, through links the crawler counts as crawlable. That makes depth relative to whatever you seed the crawl with — start from the homepage and you get homepage-relative depth; add sitemap URLs, a URL list, or other seeds, and the numbers stop being comparable to a homepage-only crawl. State what you seeded from before you compare depth numbers.

Evidence for this claim A page's crawl or click depth is the length of the shortest path from the chosen crawl seed to that page through links the crawler accepts as crawlable. Scope: crawlable internal-link graphs and URL-source audits Confidence: high · Verified: Pages With High Crawl Depth

This is the most common confusion, so it’s worth stating bluntly. Depth comes from the link path, not the URL string. Mueller, in a 2018 Webmaster Central hangout:

“From our point of view we don’t count slashes in the URLs.”

A page at /a/b/c/d/page/ that’s linked from the homepage is depth 1. A page at /page/ that’s six clicks down the link graph is depth 6. Google’s own URL-structure guidance asks you to keep URLs logical and readable — but it never equates folder depth with click depth. So don’t flatten your folder structure to “reduce depth”; change where pages are linked from. Evidence for this claim Google's URL guidance addresses logical, descriptive URL structure but does not equate folder count with click depth. Scope: Google URL structure guidance. Confidence: high · Verified: Google: URL structure best practices

A corollary: Google only follows links it can see. Per Search Central, “Google can only crawl your link if it’s an <a> HTML element with an href attribute.” A “link” that’s really an onclick handler or a <button> with no href may not be followed — so a page you think is one click deep via a JavaScript menu can be far deeper (or undiscoverable) in practice. The same goes for template and device variants: a desktop mega-menu and a collapsed mobile nav don’t always expose the same links, so a depth audit should say which rendered version — and which device — it measured. In my How Search Works talk I make the same point about Google’s link parsing missing JS-driven navigation; it’s a real way to accidentally inflate effective depth. Evidence for this claim Google recommends crawlable anchor elements with href attributes and says every important page should be linked from another page. Scope: Google link discovery; it does not establish a universal click-depth threshold. Confidence: high · Verified: Google: Link best practices

Why crawl depth matters for SEO

Five reasons, roughly in order of how concrete they are:

  • Discovery. Crawlers find pages by extracting links. A deep page is found later; an orphan (no internal links) may never be found. Google’s link guidance is blunt about the fix: “Every page you care about should have a link from at least one other page on your site.”
  • Crawl frequency. Pages closer to the homepage tend to be crawled more often. Depth feeds into how a crawler prioritizes, which ties into crawl budget — though for most sites that budget isn’t a constraint to begin with.
  • Importance signal. Google infers importance from proximity to the homepage. Mueller: “What does matter for us a little bit is how easy it is to actually find the content.” If something is one click from home, that’s a vote for its importance.
  • Link equity. PageRank flows through internal links. Shallow, well-linked pages accumulate more of it; pages stranded at the bottom of the graph get less.
  • User experience. People also find things faster when they aren’t ten clicks deep. The SEO and UX cases point the same direction here.

A useful framing from my own Beginner’s Guide to Technical SEO: “Internal links are links from one page on your site to another page on your site. They help your pages be found and also help the pages rank better.” Crawl depth is just the architectural expression of that.

Is the “3-click rule” real?

Short version: no — not as a Google rule.

The “everything within three clicks” idea is a UX rule of thumb (it traces back to the early 2000s), and it’s intuitive enough that it became SEO gospel. But:

  • Google has never named a number. There’s no Google statement of a click-count threshold. What Google says is about reachability and importance, not “three.”
  • Bing does name three. Bing’s webmaster guidance recommends a broad-to-specific structure so important pages are reachable, in their phrasing, “ideally within three clicks from the homepage.” So if you’ve heard “three clicks” attached to a search engine, it’s Bing, not Google.
  • UX research doesn’t back the rule either. Nielsen Norman Group tested it and concluded “user dropoff does not increase when the task involves more than 3 clicks, nor does satisfaction decrease.” The number of clicks alone doesn’t predict whether people succeed; clarity of the path matters more.

So the honest framing: keep important pages shallow because it helps discovery, crawl frequency, and importance signals — not because three is a magic threshold. Treat a three- or four-click threshold as a triage heuristic — a fast way to flag important pages that might be under-linked — not a pass/fail test to apply uniformly across every URL on the site.

A note on a stat you’ll see floating around. A claim that “94% of top pages are within 3 clicks” (and that anything past five clicks is an orphan) gets repeated on a lot of SEO blogs. I couldn’t find a primary source for it, and it appears to be a garbled echo of an unrelated Ahrefs figure. I’m leaving it out rather than repeat an unsourced number.

Flat vs. deep vs. pyramid

It’s tempting to “fix” depth by flattening everything — linking thousands of pages from the homepage so nothing is far away. Don’t. Mueller’s warning about overly flat architectures: “Whereas if it’s very flat, then we think, oh all of these are equally important.” If everything is one click from home, you’ve thrown away the hierarchy Google uses to understand what’s important.

The other extreme is just as bad — burying content so deep that, in Mueller’s words, “you don’t want it to be such that it’s like you have to click through a million times to actually get to the actual content.”

His recommendation is the middle path: “So from my point of view, I think for a lot of sites it makes sense to have more of a pyramid structure.” Homepage at the top, broad category/hub pages a click down, specific pages below those. Important pages sit a few clicks from home; the hierarchy still communicates relative importance.

How to check crawl depth

Every serious crawler reports depth; the gotchas are in how they compute it.

  • Screaming Frog SEO Spider. The “Crawl Depth” column is clicks from the start URL (depth 0). It flags pages with high crawl depth as an issue. Watch two things: the start URL is depth 0 (crawl from the homepage if you want homepage-relative depth), and a redirect counts as a hop — a page reached via a 301 reads one level deeper than the same page linked directly.
  • Ahrefs Site Audit. Reports each page’s Depth, and the maximum click depth setting controls how deep the crawl itself goes. If you cap it, you’ve also capped the depth numbers you’ll see — a page beyond the cap shows as uncrawled, not as “very deep.”
  • Semrush / Sitebulb. Both expose a crawl-depth metric and depth-based reports for the same purpose.

A useful audit doesn’t stop at “what’s the deepest page.” Bucket every page you care about by depth and by template, so a handful of intentionally deep pages don’t hide a widespread architecture problem — or a single outlier doesn’t make the whole site look worse than it is.

The general gotchas: the start URL changes every number; redirect chains add hops; JS-only links can hide the real path; the render mode and device you crawl with (JS-rendered vs. raw HTML, desktop vs. mobile nav) can expose a different link graph entirely; and the crawler’s own depth-limit setting can artificially cap reported depth — pages beyond that cap show up as uncrawled, not as proven to sit at any particular depth. Two tools can disagree on the same site purely because of these settings.

For the ground truth on what bots actually reached — versus what a simulated crawl predicts — server-side log file analysis is the complement to a depth audit.

How to reduce crawl depth

In rough priority order:

  • Add internal links from shallow, authoritative pages. A contextual link from a high-traffic, low-depth page is the most direct way to pull a deep page up.
  • Use hub / category pages. A well-organized hub linking to its cluster keeps every member of that cluster a click or two from the hub (and the hub a click from home).
  • Tidy navigation, footer, and breadcrumbs. These are site-wide links; what you put in them defines the shallow layer. Breadcrumbs also create consistent upward link paths.
  • Fix orphan pages. Give every page you care about at least one internal link.
  • Handle pagination and faceted navigation. Deep paginated archives and facet combinations are the classic way products end up eight clicks deep. Favor “view all” or hub pages over forcing crawlers through endless “next” links, and don’t hide the real path behind load-more JavaScript.
  • Fix redirect chains. Each hop in a chain adds a level; collapsing chains to a single 301 removes the extra depth.
  • Add an HTML sitemap for very large sites as a supplementary shallow path.

And the counterweight: don’t over-flatten. The goal is important pages within a few clicks, not everything one click from home. As crawl efficiency goes, you raise discovery far more by removing waste and linking smartly than by trying to make the whole site one level deep.

If you’re testing a depth change — a new hub, a nav restructure — measure it properly. Crawl before and after with the same configuration (same seed, render mode, and depth cap) so the numbers are actually comparable, decide up front which pages and templates you expect to move, and give it a defined window. Then look at crawling, indexing, and rankings as separate outcomes: a shallower path doesn’t guarantee any of them moves, and a traffic change in that window isn’t proof the depth change caused it.

When crawl depth matters most

Depth is a bigger deal on:

  • Large sites and e-commerce with deep faceted catalogs, where products can sink many clicks deep.
  • News and archive sites where pagination pushes older content down.
  • New sites, where discovery is the bottleneck and you can’t afford pages that aren’t reachable.

These are the same conditions where crawl budget starts to matter — the two are related but distinct: depth is about a single page’s distance and discoverability, while crawl budget is the broader rate-and-demand envelope. As I cover in my crawl budget guide, most sites never need to worry about budget at all; depth, though, is worth a quick audit on almost any site.

Add an expert note

Pin an expert quote

New person? Create their unclaimed profile at /admin/experts/ → Pin an expert quote first.