Wayback Machine Snapshots Scraper — Internet Archive History

Pricing

Rating

Developer

Actor stats

Categories

Share

List every Internet Archive snapshot of a URL, page, or whole domain — with timestamp, snapshot URL, status code, mime type, and content length. No login.

What you get

• Every archived capture of a URL since the page first hit the Wayback Machine
• Direct snapshot URLs (https://web.archive.org/web/{timestamp}/{url}) — paste straight into a browser
• HTTP status code, MIME type, and byte size for each capture
• Content digest, so you can dedupe identical captures and only see when the page actually changed
• Date-range, status-code, and MIME-type filters
• Match modes: exact URL, prefix, hostname, or whole domain (covers subdomains)
• Cursor-based pagination — fetch unlimited captures across multiple runs
• Direct export to JSON, CSV, Excel, or Google Sheets

Use cases

• SEO and competitive intel — track when a competitor changed their pricing, copy, or layout
• OSINT — recover deleted or modified pages, track changes over time
• Broken-link recovery — find the most recent working snapshot of a 404'd page
• Content audit — list every URL ever archived for a domain (subdomains included)
• Compliance and legal — produce a timeline of what a site looked like on a given date

How to use

1. Enter a URL (e.g. example.com, https://example.com/page)
2. Choose a Match Type:
   • Exact — only this URL
   • Prefix — this URL and everything below
   • Host — every URL on this hostname
   • Domain — every URL across the whole domain and its subdomains
3. Optionally filter by Date from / Date to (YYYY-MM-DD), HTTP status code (e.g. 200), or MIME type (e.g. text/html)
4. Toggle Collapse duplicate captures to dedupe by content digest (recommended)
5. Set Max snapshots (default 1000; 0 for unlimited)
6. Run the actor — one snapshot per row in the Dataset tab
7. To fetch more snapshots, open the Key-value store tab → copy the NEXT_PAGE_ID value → paste it into Page ID on your next run

Output format

One snapshot per dataset row — perfect for direct CSV, Excel, or Google Sheets export:

{
"timestamp":"20231215120000",
"archivedAt":"2023-12-15T12:00:00.000Z",
"originalUrl":"http://example.com/",
"snapshotUrl":"https://web.archive.org/web/20231215120000/http://example.com/",
"statusCode":200,
"mimeType":"text/html",
"contentLength":1234,
"digest":"ABC123XYZ"
}

Pagination

Big sites can have hundreds of thousands of snapshots. The actor saves a resume cursor (the Internet Archive's CDX resume key) to the default Key-value store under NEXT_PAGE_ID.

1. Open the Key-value store tab on the run page
2. Copy the value of NEXT_PAGE_ID
3. Start a new run and paste it into Page ID

When NEXT_PAGE_ID is null, all snapshots have been fetched.

Input options