Common Crawl observed 46 of 49 SEO tool homepages in one index
Exact-homepage coverage for a fixed SEO software cohort in Common Crawl's CC-MAIN-2026-34 index, using metadata only.
2 evidence signals on this page
- Original research or data studyThis article is explicitly classified as a study.
- Linked source dataDownload the dated JSON snapshot
Common Crawl's CC-MAIN-2026-34 index contained at least one record for 46 of 49 exact SEO software homepages in the fixed cohort. Three were not observed and none failed collection. This is exact-homepage presence in one Common Crawl release, not complete site coverage, Google indexing, or a market-share measure.
The CC-MAIN-2026-34 Common Crawl index contained at least one metadata record for 46 of the 49 exact homepages in this fixed SEO software cohort.
Exact homepage coverage in CC-MAIN-2026-34
46 of 49 exact cohort homepages were observed in this Common Crawl index release.
View chart data
| Measure | Homepages |
|---|---|
| Observed | 46/49 |
| Not observed | 3/49 |
| Collection failed | 0/49 |
Presence in one Common Crawl index. Not observed does not mean the page or site does not exist.
Methodology: The collector queried CDX index metadata for one exact public homepage per cohort origin. It downloaded no WARC bodies and retained no discovered paths. Common Crawl index.
Limits
This answers a narrow, reproducible question: “Was this exact homepage URL represented in this index release?” It does not measure complete site coverage, crawl budgetThe number of URLs an engine will crawl in a timeframe., GooglebotGooglebot is Google's web crawler — the software that fetches pages so Google can index and rank them. It comes in two variants, Googlebot Smartphone (primary, under mobile-first indexing) and Googlebot Desktop, and runs an evergreen Chromium renderer. behavior, search visibility, product adoption, or business size.
Download the dated JSON snapshot.
Build-time retrieval analysis plus live signals for this exact article. The automatic chunk report includes a deterministic readiness score and is ready without a model download.