VOOZH about

URL: https://apify.com/alizarin_refrigerator-owner/firecrawl-website-crawler

โ‡ฑ Firecrawl Website Crawler ยท Apify


Pricing

from $0.01 / 1,000 results

Go to Apify Store

Firecrawl Website Crawler

Enhanced Website Crawling with Superior JS Rendering Enhanced website crawler using Firecrawl's Crawl API for superior JavaScript rendering, smart rate limiting, anti-bot bypass, and clean markdown extraction.

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

๐Ÿ‘ The Howlers

The Howlers

Maintained by Community

Actor stats

1

Bookmarked

47

Total users

6

Monthly active users

2 months ago

Last modified

Share

Enhanced website crawler using Firecrawl's Crawl API for superior JS rendering, smart rate limiting, anti-bot bypass, and clean markdown extraction.

BYOK (Bring Your Own Key) -- you provide your own API credentials.


Before You Start

This actor requires your own API credentials to fetch real data.

Where to get your key: Your Firecrawl API key. Get one at firecrawl.dev

You can test with Demo Mode first (free, no key needed) to see the output format before committing.


Quick Start

Test with Demo Mode (free, no API key needed)

{
"demoMode":true,
"url":"https://example.com",
"includeSubdomains":[
"example.com"
]
}

Run with real data

{
"demoMode":false,
"url":"https://example.com",
"maxPages":100,
"maxDepth":5,
"includeSubdomains":false,
"outputFormat":"markdown",
"includeScreenshots":false,
"firecrawlApiKey":"YOUR_API_KEY_HERE"
}

Input Parameters

ParameterTypeDefaultRequiredDescription
urlstring-Yes*The website URL to crawl (e.g., https://example.com)
maxPagesinteger100NoMaximum number of pages to crawl
maxDepthinteger5NoMaximum crawl depth from the starting URL
includeSubdomainsbooleanfalseNoCrawl subdomains of the main domain
excludePatternsarray-NoURL patterns to exclude from crawling (regex supported)
includePatternsarray-NoOnly crawl URLs matching these patterns (regex supported)
outputFormatstring"markdown"NoFormat for extracted content
includeScreenshotsbooleanfalseNoCapture screenshots of each page
waitForSelectorstring-NoCSS selector to wait for before extracting content (for JS-heavy sites)
countrystring-NoCountry code for geo-targeted crawling (e.g., 'US', 'GB')
firecrawlApiKeystring-Yes*Your Firecrawl API key. Get one at firecrawl.dev
webhookUrlstring-NoURL to receive results via webhook when complete
demoModebooleantrueNoRun in demo mode with sample data (no API key required). Set to false when using your own Firecrawl API key.

*Required when Demo Mode is off.


Troubleshooting

"API key is required"

You have Demo Mode turned off but didn't provide an API key. Either:

  • Turn Demo Mode on to test with sample data
  • Add your API key in the input

"API error 403" or "Unauthorized"

Your API key is invalid, expired, or doesn't have access to this specific API endpoint. Double-check your key and account permissions.

"API error 429" or "Rate limit"

Too many requests. Wait a minute and try again, or reduce the number of items per run.

No results or empty dataset

Check the run log for error messages. Common causes:

  • Invalid input format (check the examples above)
  • API key without proper permissions
  • The target data doesn't exist or is too small to track

How do I test without an API key?

Enable Demo Mode in the input. This returns realistic sample data so you can verify the output format works for your workflow.


Built by John Rippy | Actor Arsenal

You might also like

๐Ÿ”ฅ FireScrape AI Website Content Markdown Scraper

mohamedgb00714/fireScraper-AI-Website-Content-Markdown-Scraper

Advanced web scraper powered by Crawlee and Puppeteer โ€” extracts website content, converts it to Markdown, and structures it for LLM training datasets.

๐Ÿ‘ User avatar

mohamed el hadi msaid

302

1.9

LinkedIn User Comments & Reactions Scraper [NO COOKIES] โœ…

unseenuser/LinkedIn-user-comments-reactions

See exactly what any LinkedIn user has commented on or reacted to recently - their full engagement history. Surface what topics they care about and which thought leaders they follow. No login, no cookies. Built for personalized B2B outreach and ABM teams.

502

5.0

Firecrawl Agent - Web Crawler

alizarin_refrigerator-owner/firecrawl-agent

Advanced web crawling with Firecrawl. Extract clean markdown, handle JavaScript sites & manage large-scale crawls with built-in rate limiting & error handling.

LinkedIn Hashtag & Topic Post Tracker (No Cookies)

scrapemint/linkedin-hashtag-posts-scraper

Discover top public LinkedIn posts by hashtag or topic without a login or cookie. Each row carries author, post body, posted date, engagement counts, hashtags matched, and media. Bring your own hashtag list. Pay per post.

Website Content Crawler

ayeeyee/website-content-crawler

Full website crawling

๐Ÿ‘ User avatar

Virtual Footprint LLC

1

LinkedIn Profile Comments & Reactions Scraper No Cookies

scraping_solutions/linkedin-profile-comments-reactions-scraper-no-cookies

Extract comments and reactions from LinkedIn profiles with structured, deduplicated data. Supports multiple users, date and filtering. Ideal for analytics, lead generation, and engagement tracking.

๐Ÿ‘ User avatar

Scraping Solutions

106

Citation Builder

alizarin_refrigerator-owner/citation-builder

Build local SEO citations by automatically submitting your business NAP (Name, Address, Phone) to 45+ directories. Why Citations Matter Local citations are mentions of your business name, address, and phone number on other websites. They're a critical local SEO ranking factor:

Linkedin Hashtag Posts Urls Scraper

sasky/linkedin-hashtag-posts-urls-scraper

Scrapes Linkedin posts URLs related to a given hashtag

Abdulrahman

196