Pricing

Rating

Developer

Actor stats

Categories

Share

Sitemap to URL List Extractor 🗺️

Extract every URL from any website's sitemap as clean structured JSON, with last-modified dates, priority, and change frequency. Handles sitemap indexes (recursing into nested sitemaps) and gzipped sitemaps (.xml.gz) automatically — the parts most lazy sitemap scrapers get wrong.

Perfect for SEO audits, content inventories, building crawl lists, monitoring site changes, and feeding URL lists into other tools.

Why use it

• 🔁 Recursive sitemap indexes — point it at sitemap_index.xml and it'll follow every nested sitemap automatically
• 📦 Gzipped sitemaps handled — many large sites ship .xml.gz, decompressed transparently
• 🗓️ Full metadata — lastmod, priority, changefreq, plus image URLs from the Google image sitemap extension
• 🛡️ Guardrails — configurable caps on total URLs and nested sitemaps so a giant site can't run away
• 🌐 Works on any website — news sites, e-commerce stores, blogs, documentation, public web apps

Use cases

• SEO audits — list every indexed URL on a site, sort by lastmod, find stale content
• Crawl seed lists — generate URL lists for downstream scrapers or archival tools
• Content inventories — see what a competitor or partner site is actually publishing
• Change monitoring — schedule it and detect newly added pages
• Site migrations — get the full URL set before redirect mapping

Input

Output

{
"url":"https://example.com/page1",
"lastModified":"2025-05-10",
"changeFrequency":"weekly",
"priority":"0.8",
"images":["https://example.com/img1.jpg"],
"sourceSitemap":"https://example.com/sitemap-products.xml",
"sourceRoot":"https://example.com/sitemap_index.xml"
}

Export to JSON, CSV, or Excel, or pull via the Apify API.

Notes

• Supports the standard sitemaps.org protocol, sitemap index files, and the Google image-sitemap extension.
• Always respects each site's robots.txt policy on access — please use responsibly.
• Independent tool; sitemaps remain the property of their publishers.