VOOZH about

URL: https://apify.com/alizarin_refrigerator-owner/sitemap-generator

โ‡ฑ Sitemap Generator ยท Apify


Pricing

from $0.01 / 1,000 results

Go to Apify Store

Generate XML sitemaps by crawling any website. Discover all pages, images, & videos with configurable crawl depth, URL filters, & multiple output formats. Full Site Crawling ,Image Sitemap, Video Sitemap, Multiple Output Formats, URL Filtering, Configurable Depth, Last Modified, Webhook Integration

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

๐Ÿ‘ The Howlers

The Howlers

Maintained by Community

Actor stats

0

Bookmarked

15

Total users

0

Monthly active users

2 months ago

Last modified

Share

Generate XML sitemaps by crawling any website. Discover all pages, images, and videos with configurable crawl depth, URL filters, and output formats. Built by John Rippy (https://www.linkedin.com/in/johnrippy/ | https://johnrippy.link/).


Quick Start

Test with Demo Mode (free, no API key needed)

{
"demoMode":true,
"startUrl":"https://example.com",
"urlPatterns":"https://example.com"
}

Run with real data

{
"demoMode":false,
"startUrl":"https://example.com",
"maxPages":1000,
"maxDepth":10,
"includeImages":true,
"includeVideos":false,
"includeLastmod":true,
"respectRobotsTxt":true,
"urlPatterns":[],
"excludePatterns":[
"\\.(jpg|jpeg|png|gif|svg|webp|pdf|zip|exe)$",
"/cdn-cgi/",
"\\?",
"#"
],
"outputFormat":"xml",
"changefreq":"weekly",
"priority":0.5
}

Input Parameters

ParameterTypeDefaultRequiredDescription
startUrlstring-NoThe website URL to crawl and generate a sitemap for
maxPagesinteger1000NoMaximum number of pages to crawl (0 = unlimited)
maxDepthinteger10NoMaximum link depth from start URL (0 = only start page)
includeImagesbooleantrueNoInclude image URLs in the sitemap (creates image sitemap extension)
includeVideosbooleanfalseNoInclude video URLs in the sitemap (creates video sitemap extension)
includeLastmodbooleantrueNoTry to detect last modified dates from HTTP headers or meta tags
respectRobotsTxtbooleantrueNoFollow robots.txt rules when crawling
urlPatternsarray[]NoOnly include URLs matching these patterns (regex). Leave empty to include all.
excludePatternsarray`["\.(jpgjpegpng
outputFormatstring"xml"NoFormat of the generated sitemap
changefreqstring"weekly"NoDefault change frequency for all URLs
prioritynumber0.5NoDefault priority for all URLs (0.0 to 1.0)
webhookUrlstring-NoURL to receive a POST request when sitemap generation is complete
demoModebooleantrueNoRun with sample data instead of actual crawling (for testing)

Pricing

This actor uses pay-per-event billing:

EventDescriptionPrice
URL DiscoveredEach URL discovered during crawl$0.01

Demo mode is free -- no charges for sample data.


Troubleshooting

"API error 429" or "Rate limit"

Too many requests. Wait a minute and try again, or reduce the number of items per run.

No results or empty dataset

Check the run log for error messages. Common causes:

  • Invalid input format (check the examples above)
  • The target data doesn't exist or is too small to track

How do I test without an API key?

Enable Demo Mode in the input. This returns realistic sample data so you can verify the output format works for your workflow.


Built by John Rippy | Actor Arsenal

You might also like

Sitemap Generator

gentle_cloud/sitemap-generator

Crawl websites and generate XML sitemaps with configurable depth and page limits. Discover all pages, extract metadata, and output a ready-to-use sitemap.xml.

Sitemap Generator โ€” Full-Site URL Discovery & Crawling

junipr/sitemap-generator

Generate XML sitemaps by crawling websites. Link following, robots.txt respect, configurable depth/limits. Valid XML with lastmod, changefreq, priority. URL inventory with status codes. Ideal for SEO and migrations.

Sitemap & URL Discovery - Find All URLs on Any Site

santamaria-automations/sitemap-url-discovery

Discover every URL on any website by parsing sitemap.xml, robots.txt, and sitemap indexes. Extract URLs with last modified dates, change frequency, and priority. Perfect for SEO audits, content analysis, crawling preparation, and site mapping.

Sitemap Generator

himalyancoder/Sitemap-generator

Sitemap URL Extractor - List All URLs in a Sitemap

dltik/sitemap-url-extractor

Extract every URL from any XML sitemap, with lastmod, changefreq and priority. Resolves sitemap indexes recursively. Pass a sitemap.xml or just a site root to auto-discover its sitemaps. Pure HTTP, no browser โ€” fast and cheap.

Sitemap Generator

datawinder/sitemap-generator

Automatically crawl a website and generate an SEO-ready sitemap in XML, HTML, or TXT format. Supports crawl depth limits, URL include/exclude patterns, and optional merging with an existing sitemap.xml. Ideal for SEO audits, site migrations, and automation.

๐Ÿ‘ User avatar

DatawinderLabs

2

Sitemap Scraper

pvillalva/sitemap-scraper

The Sitemap Scraper extracts and outputs all URLs from a given sitemap.

๐Ÿ‘ User avatar

Percival Villalva

268