Pricing

Rating

Developer

Actor stats

Categories

Share

Reddit Scraper

Scrape Reddit posts and comments from any subreddit. Extract titles, scores, comment text, authors, and nested reply threads at scale. No API key or login required.

What It Does

Fetches posts from one or more subreddits using Reddit's public Atom feeds (/.rss). Optionally fetches comments for each post. Posts and comments are returned as separate items in the dataset.

Use with AI Agents (MCP)

Connect this actor to any MCP-compatible AI client — Claude Desktop, Claude.ai, Cursor, VS Code, LangChain, LlamaIndex, or custom agents.

Apify MCP server URL:

https://mcp.apify.com?tools=santamaria-automations/reddit-scraper

Example prompt once connected:

"Use reddit-scraper to get the top 50 posts from r/MachineLearning this week with comments. Return results as a table showing title, score, and comment count."

Features

• Multi-subreddit — scrape multiple subreddits in a single run
• Comments included — fetch comments for each post (flat list, see notes below)
• Search — query Reddit-wide, sort by relevance / top / new / hot
• User profiles — pull a user's posts and comments
• Sorting options — hot, new, top, rising
• Deduplication — the same post is never returned twice
• Pagination — uses Reddit's after cursor to collect more than 100 posts
• Anti-bot resilient — TLS fingerprinted sessions, rotating proxy IPs
• Rate-limit aware — paces requests well under Reddit's public limits
• No credentials needed — uses Reddit's public Atom feeds
• Pay-per-result — only pay for items you receive

Data Extracted

Posts (type = "post")

Comments (type = "comment")

Notes on score, num_comments, and parent_id: Reddit's public Atom feeds do not expose vote totals, comment counts, or comment parent-IDs. These fields are returned as 0 / null. For everything else (title, author, body text, URLs, timestamps), the data is identical to what you'd see on the site.

Pricing

Pay-per-result pricing. You only pay for items you receive.

Examples:

• 100 posts (no comments) = $0.08 total ($0.005 + $0.075)
• 100 posts + 500 comments = $0.455 total ($0.005 + $0.45)
• 1,000 posts + 5,000 comments = $4.505 total ($0.005 + $4.50)

6x cheaper than competing Reddit scrapers ($5/1k+). No monthly fees. No minimum spend.

No monthly fees. No minimum spend.

Input

Usage Examples

Scrape hot posts from multiple subreddits

{
"subreddits":["programming","python","golang"],
"sort":"hot",
"maxResults":200
}

Get top posts with full comment threads

{
"subreddits":["MachineLearning"],
"sort":"top",
"includeComments":true,
"commentDepth":3,
"maxCommentsPerPost":50,
"maxResults":100
}

Scrape new posts without comments

{
"subreddits":["startups","SaaS"],
"sort":"new",
"maxResults":500
}

Search Reddit

{
"searchQuery":"artificial intelligence startup",
"sort":"top",
"maxResults":50
}

Scrape a user's activity (experimental)

{
"usernames":["AutoModerator"],
"maxResults":50
}

Note: Reddit applies stricter rate limiting on user profile pages. Some users may return fewer results.

Deep comment mining from a single subreddit

{
"subreddits":["AskReddit"],
"sort":"hot",
"includeComments":true,
"commentDepth":5,
"maxCommentsPerPost":200,
"maxResults":20
}

Output

Results are exported to the default dataset. Posts and comments are interleaved — each post is followed by its comments (if includeComments is enabled). Use the type field to filter posts vs comments.

Export to JSON, CSV, Excel, or connect via the Apify API.

FAQ

Do I need a Reddit account or API key? No. This scraper uses Reddit's public Atom feeds which are accessible without authentication.

What is the rate limit? The scraper paces requests at ~1 every 1.5 seconds. With proxy rotation enabled (default), you can run multiple actors in parallel without hitting limits.

Can I scrape private subreddits? No. Only public subreddits and posts visible without logging in are accessible.

How are comments structured? Each comment is a separate output item with type: "comment". The post_id and post_title fields reference the original post. Comments come back as a flat list — the parent-comment relationship is not exposed by the Atom feed.

Why no score or num_comments? Reddit removed access to its /.json endpoints in June 2026. The Atom (/.rss) feed is the only public surface that still works without a registered API app, and it doesn't expose vote counts. If you need scores, use Reddit's official OAuth API.

Why do I need a proxy? A proxy isn't required, but Reddit will rate-limit a single IP after a few quick requests. Apify's auto/datacenter proxy is sufficient — no residential proxy needed.