Crawl Export Comparator
Free, no signup. Compare two crawl exports without forcing unlike vendor issue taxonomies into fake equivalence. Shared page evidence is normalized; unmapped columns and incomplete crawl coverage remain visible.
Runs entirely in your browser — nothing you paste is uploaded or stored. Both files stay in your browser. Files over 15 MiB and rows beyond the 100,000-row comparison cap are rejected or reported as truncated. Anonymous run-level outcome counters may be used for aggregate research; URLs, domains, IPs, and identifiers are never included, and no statistic is released below 100 runs.
Sample report Static output-shape example
5 changed URLs · 2 added · 2 removed · 1 field-changed
/products/:number — 1 added, 1 removed; verify whether product IDs changed or the crawl scopes differed.
https://example.com/ — meta description and word count changed.
This illustrates the report structure. It is not a live observation or a claim that every difference is a defect.
Changes by path template
Changed URLs
| State | URL | Template | Changed evidence |
|---|
How to use it
- Export page-level CSV or TSV files from the before and after crawls.
- Use comparable crawl scope, robots, rendering, authentication, and limits.
- Load both files and review the detected vendor, mapped fields, ignored columns, invalid URLs, duplicates, and caps.
- Triage inventory changes by path template, then inspect field changes per URL.
- Export the normalized change list and verify important regressions in the source crawlers or on the live pages.
Site passport Local context for this saved site
Local data
Saved targets, named lists, and recent check summaries remain only in this browser.
Rate this tool
How it works
The browser parses quoted CSV or TSV, detects known vendor headers, normalizes public HTTP(S) URLs, and keeps the last row when an export contains duplicate URLs. Only fields present in both exports are compared. Numeric evidence is compared numerically; canonicals and content types receive bounded normalization. The path-template rollup replaces only numeric IDs, UUIDs, and long hexadecimal segments.
What the results mean
- Added — the normalized URL appears only in the after export.
- Removed — it appears only in the before export.
- Changed — at least one mutually mapped evidence field differs.
- Ignored column — the source data is preserved in the original file but is not given cross-vendor meaning here.
Limitations
Different crawl configurations are the largest confounder. This tool does not reproduce rendering modes, authentication, robots behavior, custom extraction, vendor scoring, crawl scheduling, or site completeness. It does not infer that two differently named vendor checks mean the same thing. Template grouping is path-shape grouping, not a learned CMS template classification. The report is triage evidence, not proof of a regression.
Frequently asked questions
Which crawl exports can I compare?
The tool recognizes common page-export headers from Screaming Frog, Sitebulb, Scout Site Audit Free, and generic CSV or TSV files. It needs a URL column and compares only fields recognized in both files.
Are vendor issue names treated as equivalent?
No. Vendor-specific issue taxonomies can have different definitions and thresholds. The comparator normalizes shared page evidence such as status, indexability, title, canonical, H1, word count, depth, and inlinks. Issue labels are compared as literal sorted text only when both files provide them.
Does an added or removed URL prove a crawlability change?
No. A URL can appear or disappear because of crawl scope, limits, authentication, robots rules, settings, or a real site change. Confirm comparable crawl configurations before treating inventory differences as regressions.
Are the exports uploaded?
No. Parsing, normalization, comparison, filtering, and CSV export happen in your browser. The selected files are not sent to this site.
How are path templates created?
The grouping replaces numeric IDs, UUIDs, and long hexadecimal tokens in path segments. It is a deterministic triage aid, not a CMS-aware template detector.
Feature requests for Crawl Export Comparator
Upvote what you want most. New ideas can be submitted from the floating Feedback menu; requests appear here once approved, and the most-wanted rise to the top.
You won't be emailed about that request anymore.
Loading…
➕ Request a feature
New requests are reviewed before they appear here.
Tentang alat
Setelah rayapi
Ekspor halaman-tingkat CSV atau TSV berkas dari sebelum dan setelah crawls. Gunakan sebanding rayapi cakupan, robots, perenderan, authentication, dan batasan. Muat keduanya berkas dan tinjau detected vendor, dipetakan fields, diabaikan kolom, tidak valid URLs, duplicates, dan caps. Triage inventaris perubahan oleh jalur template, lalu periksa field perubahan per URL. Ekspor ternormalisasi perubahan daftar dan verifikasi penting regressions di sumber perayap atau pada langsung halaman.
Unduh perubahan CSV
Fitur
- Keadaan URL Template Berubah bukti
- 5 berubah URLs · 2 added · 2 dihapus · 1 field-berubah /products/:number — 1 added, 1 dihapus; verifikasi apakah produk IDs berubah atau rayapi scopes differed. https://example.com/ — meta deskripsi dan word count berubah.
- URL atau template filter
- Adalah vendor masalah menyebut diperlakukan sebagai setara?
- Added — ternormalisasi URL tampak hanya di setelah ekspor. Dihapus — ini tampak hanya di sebelum ekspor. Berubah — di least satu mutually dipetakan bukti field differs. Diabaikan kolom — sumber data adalah preserved di original berkas tetapi tidak given cross-vendor arti di sini.
Cara kerja
Bagaimana adalah jalur template created? grouping replaces numeric IDs, UUIDs, dan long hexadecimal tokens di jalur segments. Ini adalah deterministik triage aid, tidak CMS-aware template detector. Berbeda rayapi configurations adalah largest confounder. alat tidak reproduce perenderan modes, authentication, robots perilaku, custom extraction, vendor scoring, rayapi penjadwalan, atau situs completeness. Ini tidak infer yang dua secara berbeda named vendor memeriksa mean sama thing. Template grouping adalah jalur-shape grouping, tidak dipelajari CMS template klasifikasi. laporan adalah triage bukti, tidak proof dari regresi. Melakukan added atau dihapus URL buktikan crawlability perubahan?
Batasan
- alat recognizes umum halaman-ekspor header dari Screaming Frog, Sitebulb, Scout Situs Audit Gratis, dan generik CSV atau TSV berkas. Ini needs URL kolom dan membandingkan hanya fields recognized di keduanya berkas.
- Berubah URLs
- Gratis, tanpa pendaftaran. Bandingkan dua rayapi ekspor tanpa forcing unlike vendor masalah taxonomies menjadi fake equivalence. Bersama halaman bukti adalah ternormalisasi; belum dipetakan kolom dan tidak lengkap rayapi cakupan tetap terlihat.
- Menormalkan dan bandingkan dua Screaming Frog, Sitebulb, Scout, atau generik rayapi ekspor secara lokal oleh URL, field, dan jalur template.
Pertanyaan umum
Sebelum rayapi
browser parses quoted CSV atau TSV, detects diketahui vendor header, normalizes publik HTTP(S) URLs, dan mempertahankan terakhir baris ketika ekspor berisi duplikat URLs. Hanya fields present di keduanya ekspor adalah dibandingkan. Numeric bukti adalah dibandingkan numerically; canonical dan konten jenis terima dibatasi normalisasi. jalur-template rollup replaces hanya numeric IDs, UUIDs, dan long hexadecimal segments.
Perubahan oleh jalur template
Tidak. URL dapat muncul atau disappear karena dari rayapi cakupan, batasan, authentication, robots aturan, settings, atau nyata situs perubahan. Konfirmasi sebanding rayapi configurations sebelum treating inventaris differences sebagai regressions.
Tunjukkan semua perubahan added URLs dihapus URLs field perubahan
Ini illustrates laporan structure. Ini adalah bukan pengamatan langsung atau klaim yang setiap perbedaan adalah cacat.
Bandingkan ekspor
Laporan contoh Statis keluaran-shape contoh