Pricing

Rating

Developer

Actor stats

Categories

Share

Website Link Graph & Outbound Links Crawler — Link Extractor 🕸️

Extract every link from a website and map its link graph. This link extractor crawls an entire site and exports every internal and outbound link as a graph edge — the source page, the target URL, the anchor text, the link type (internal / subdomain / external) and the rel flags (nofollow, sponsored, ugc). Map a whole site's internal linking and outbound links from a single start URL. No login, no headless browser.

Need to extract all links from a website, run an internal linking SEO audit, analyze outbound / external links, or check nofollow attributes at scale? This actor builds the complete link graph.

✨ Key features

• 🕷️ Full-site crawl — start from one URL and follow internal links across the whole domain.
• 🔗 Every link as an edge — source → target with anchor text, for internal and external links.
• 🏷️ Rel & attribute parsing — nofollow, sponsored, ugc flags and target="_blank".
• 🎯 Scope control — export all links, only internal, or only outbound/external links.
• ⚡ Faster & higher-volume than a link checker — it maps the graph without HTTP status checks, so it's ideal for big sites.

💡 Use cases

• Internal-linking SEO audits — see which pages link where and with what anchor text to optimize link equity.
• Outbound / external link analysis — list every external site you link to and which links are nofollow.
• Site-structure mapping — build a link graph for visualization, analysis or crawl-budget optimization.
• Link cleanup & compliance — find sponsored/UGC links that should carry the right rel attributes.
• Anchor-text analysis — audit the anchor text distribution across an entire site.

📦 What you get

One row per link (edge):

Example output

{
"sourceUrl":"https://example.com/blog/seo-guide",
"targetUrl":"https://partner.com/tool",
"targetDomain":"partner.com",
"anchorText":"our favorite SEO tool",
"linkType":"external",
"rel":"nofollow sponsored",
"isNofollow":true,
"isSponsored":true,
"isUgc":false,
"opensNewTab":true,
"crawledAt":"2026-05-25T14:17:17.531Z"
}

🚀 How to use it

1. Click Try for free / Start.
2. Paste one or more website URLs into Start URLs.
3. (Optional) Set Max pages to crawl — 0 for the whole site.
4. (Optional) Choose Which links to export: all / internal / external.
5. Click Save & Start.
6. Export the link graph as JSON, CSV, Excel or via API.

⚙️ Input

Example input

{
"startUrls":[{"url":"https://example.com"}],
"maxPagesToCrawl":5000,
"linkScope":"all"
}

🔍 How it works

The crawler follows internal links within the same domain as your Start URLs, and on each page records every <a href> as an edge with its anchor text and rel attributes. URLs are resolved to absolute and de-duplicated per page. Use linkScope to keep only internal or only outbound links. Pure HTTP — fast and cheap.

🧰 Tips & best practices

• Use linkScope: "external" for a pure outbound-link/backlink-target report.
• Use linkScope: "internal" to analyze internal link distribution and orphan-page risk.
• Pivot on targetDomain to see which external domains you link to most.
• Set maxPagesToCrawl to 0 for complete coverage of large sites.

❓ FAQ

What's the difference vs the Broken Link Checker? This actor maps the link graph (anchors, rel, internal/external) without checking HTTP status, so it's faster and produces higher volume. Use the Broken Link Checker when you specifically need to find dead links and status codes.

Does it detect nofollow / sponsored / ugc? Yes — the rel attribute is parsed into boolean flags.

Does it render JavaScript? No — it parses server-rendered HTML for speed and low cost.

How do I crawl the whole site? Set maxPagesToCrawl to 0.

What formats can I export? JSON, CSV, Excel, HTML and a full REST API.

How do I extract all links from a website to CSV or JSON?

Paste your start URL, run the crawl, then export the link graph as CSV, JSON, Excel or via API — one row per link with source page, target URL, anchor text and rel flags.

Can I scrape website links without an API or browser?

Yes. There is no third-party API or login required, and it uses pure HTTP (no headless browser), so it extracts internal and outbound links fast and cheap.

Is this an internal linking audit and outbound link analysis tool?

Yes. Use linkScope: "internal" for an internal-linking SEO audit, or linkScope: "external" for an outbound/external link analysis report grouped by targetDomain.

Does it extract anchor text and nofollow links?

Yes. Every edge records its anchor text and parses the rel attribute into nofollow, sponsored and ugc boolean flags.

🔗 Related actors by the same author

• Broken Link Checker — crawl a site and find dead links with HTTP status codes.
• Website SEO Audit Crawler — full on-page SEO audit for every page.
• Sitemap to URL Crawler — extract all URLs from any sitemap.xml.
• Website to Markdown & Text Crawler — clean text + Markdown for AI / RAG.

📝 Changelog

2026-06-15

• Reliability pass: re-verified end-to-end on live data with real-world inputs. Routine maintenance build.

2026-06-07

• Docs: added coverage for exporting website links to CSV/JSON, scraping links without an API or browser, and internal-linking / outbound link audits.

2026-06-05

• 🛡️ Reliability fix: results are no longer dropped by strict output validation — runs now complete cleanly even at high volume (thousands of results).
• ⚡ Stability & performance hardening; fresh rebuild.

2026-06-04

• Verified live & refreshed build — reliability/maintenance pass.