VOOZH about

URL: https://apify.com/marcoet/url-mapper

⇱ URL Mapper · Apify


👁 URL Mapper avatar

URL Mapper

Under maintenance

Pricing

$2.00 / 1,000 search all links

Go to Apify Store

URL Mapper

Under maintenance

Map every link on any website in seconds. URLMapper instantly crawls a single page, returns a complete JSON of internal URLs, supports keyword filtering, and plugs straight into any Apify workflow or API so you can pre-crawl, audit SEO, or feed clean link lists into larger scrapers.

Pricing

$2.00 / 1,000 search all links

Rating

4.4

(2)

Developer

👁 Marco Elizalde

Marco Elizalde

Maintained by Community

Actor stats

0

Bookmarked

65

Total users

2

Monthly active users

7 months ago

Last modified

Share

URLMapper · Instantly list every link on a website

URLMapper turns a single URL into a clean list of all the pages it can reach in a few seconds.
Point it at any public site and the Actor returns every discovered link in a tidy, ready‑to‑export table.
Add an optional search term to keep only links that contain a specific word or path segment (e.g. docs, blog, product).


Key features

FeatureDescription
🔗 Full‑site link discoveryGenerates a complete map of internal URLs from one starting page.
🔍 Smart filter (search)Return only the links that match a substring—perfect for isolating sections such as /blog or /docs.
Fast & lightweightTypical sites (hundreds of pages) are mapped in seconds.
📥 Simple inputJust give it a url (required) and optional search.
📊 Clean outputEach link is a separate record, ideal for CSV, JSON, Sheets, or direct API use.

Typical use cases

ScenarioHow URLMapper helps
Pre‑crawl planningGrab all internal URLs and feed only the relevant ones to a heavier scraper.
SEO auditsGenerate a fresh list of live pages to cross‑check for orphan content or broken links.
Content researchCollect every article URL on a blog for sentiment, topic, or trend analysis.
Competitive analysisSnapshot a rival’s entire site structure in moments.

Input

FieldTypeRequiredExampleDescription
urlstringhttps://example.comStarting page.
searchstringblogReturn only links that contain this substring (case‑insensitive).

Output

The Actor pushes one dataset record per link:

{
"link":"https://example.com/blog/article-1"
}

Download the dataset in JSON, CSV, XLSX, or view it directly in the Apify Console.


Quick start

  1. Run in Apify Console

    • Paste the target URL in the Input tab.
    • (Optional) Add a search term to narrow the results.
    • Click Run—your link list appears in the Output tab.
  2. Call from code

import{ Actor }from'apify';
const run =awaitActor.call('marcoet/urlmapper',{
url:'https://example.com',
search:'blog',// optional
});
// Access dataset items
const{ items }=await Actor.openDataset(run.defaultDatasetId).listItems();
console.log(items);// [{ link: 'https://example.com/blog/...' }, …]

Tips

  • Large sites – If a site contains tens of thousands of pages, consider splitting the task per sub‑section (search = '/docs', /blog, etc.).
  • Combining Actors – Use URLMapper first, then feed the resulting dataset to other Apify scrapers via Webhooks or the API.
  • Scheduling – Map the same site daily or weekly to track new pages over time.

Need help?

Open an issue in the Actor’s Issues tab or join the Apify Discord community. Happy mapping!

You might also like

Website URL Extractor - Get All Site URLs

lofomachines/urls-extractor

Extract every URL from any website automatically — no code needed. This URL extractor crawls pages and parses XML sitemaps into one structured list with metadata (lastmod, priority, changefreq). Filter by keyword, cap results, and export to JSON, CSV, or Excel. Built for SEO audits & migrations.

👁 User avatar

Lofomachines

152

5.0

Fast Sitemap Generator

eunit/sitemap-generator

Boost SEO with this automatic Sitemap Generator. Crawl any site to create XML, HTML, & TXT sitemaps. Supports custom depth, regex filters, & robots.txt. Compatible with Google Search Console.

👁 User avatar

Emmanuel Uchenna

31

5.0

Google Indexer & Instant SEO Submitter

eunit/google-indexing

Instantly index your URLs with the Google Indexing API. Automate sitemap submissions, speed up crawling, and boost SEO rankings. Perfect for fresh content, bulk indexing, and removing dead links. Fast, secure, and pay-per-result!

👁 User avatar

Emmanuel Uchenna

25

5.0

Website Scraper Search Email, Phone, & Social Media

scraping_solutions/website-scraper-search-email-phone-social-media

Automatically extracts emails, social media links, and phone numbers from any website. Perfect for quickly gathering contact details and online presence data of businesses or professionals.

👁 User avatar

Scraping Solutions

106

Easy IndexNow

onescales/easy-indexnow

Fast-track your content indexing with IndexNow. Bulk submit up to 10,000 URLs and instantly notify ChatGPT, Bing, Yandex, Naver, Seznam and Yep about your website page updates. (Simple easy indexing for search engines & SEO)

284

5.0

Website Tech Profiler

lofomachines/website-tech-profiler

Advanced technology stack scraper and Wappalyzer alternative. Detect frontend frameworks (React, Vue, Angular), backend technologies, CDN, hosting providers, analytics, advertising scripts, API endpoints, and more. Complete techstack analysis for competitive research and lead generation.

👁 User avatar

Lofomachines

87

5.0

Shopify AppStore Scraper

scoutlayer/shopify-appstore-scraper

A powerful Apify Actor designed to extract comprehensive data from the Shopify App Store. This scraper can discover all available apps, collect detailed application information, and extract user reviews from any Shopify app, making it perfect for market research, and competitor analysis.

202

5.0

Shopify Lead Scraper with 1M+ Email Database

xmiso_scrapers/shopify-shops-email-leads-scraper

scrape shopify powered shops for ecommerce email leads from merchantgenius and own scraped sources.

1.3K

2.9

Link Extractor

automation-lab/link-extractor

This actor extracts all hyperlinks from web pages. For each link, it captures the anchor text, href, rel attributes (nofollow, ugc, sponsored), target attribute, and classifies links as internal or external. It also detects the link's location in the page (nav, header, footer, main content,...

👁 User avatar

Stas Persiianenko

69