Beehiiv Newsletter Scraper

Pricing

Rating

Developer

Actor stats

Categories

Share

Scrape posts from any beehiiv-powered newsletter. Input a list of publication domains or subdomains — the actor discovers post URLs via sitemap and extracts title, author, publish date, excerpt, cover image, tags, and word count. Supports multi-newsletter fan-out in a single run.

What it does

The actor accepts a list of beehiiv publication domains (e.g. readthepeak.com, discover.beehiiv.com) and for each domain:

1. Fetches <domain>/sitemap.xml to discover all public post URLs matching the /p/<slug> pattern.
2. Crawls each post page and extracts structured data from the embedded JSON-LD Article schema.
3. Yields one record per post with all metadata fields.

Publications that sit behind Cloudflare or other anti-bot measures are gracefully skipped with a warning. Free posts are scraped; paywalled posts (where isAccessibleForFree: false in JSON-LD) are automatically skipped.

Input

Example input:

{
"domains":["readthepeak.com","discover.beehiiv.com"],
"maxItems":50
}

Output

Each record contains:

Example output record:

{
"publication_domain":"readthepeak.com",
"publication_name":"The Peak",
"post_url":"https://www.readthepeak.com/p/canadian-universities-are-falling-behind",
"post_title":"Canadian universities are falling behind",
"post_subtitle":"Canada's post-secondary schools are losing their edge.",
"author":"Lucas Arender",
"publish_date":"2026-06-02T10:00:00.000Z",
"excerpt":"Canada's post-secondary schools are losing their edge.",
"cover_image_url":"https://beehiiv-images-production.s3.amazonaws.com/...",
"word_count":291,
"tags":"Water Cooler, Perspectives",
"full_text":"",
"scraped_at":"2026-06-02T20:39:48.116Z"
}

Limitations

• Publications behind Cloudflare or PerimeterX (e.g. some high-traffic custom domains) will return a warning and be skipped. Use a different domain format if the publication has a *.beehiiv.com subdomain that is not CF-walled.
• Paywalled posts (subscriber-only) are detected via JSON-LD and automatically skipped.
• Publications without a sitemap.xml or with no /p/ posts in their sitemap are skipped.
• full_text extraction is best-effort — post body selectors may vary slightly across beehiiv themes.