VOOZH about

URL: https://apify.com/moving_beacon-owner1/my-actor-76

⇱ Hacker News Scraper · Apify

Pricing

from $10.00 / 1,000 results

Go to Apify Store

Hacker News Scraper

A production-ready Apify Actor that scrapes Hacker News stories, comments, user profiles, and search results using the official Firebase API and Algolia HN Search API.

Pricing

from $10.00 / 1,000 results

Rating

0.0

(0)

Developer

👁 Jamshaid Arif

Jamshaid Arif

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 months ago

Last modified

Share

🟧 Hacker News Scraper — Apify Actor (Python)

A production-ready Apify Actor that scrapes Hacker News stories, comments, user profiles, and search results using the official Firebase API and Algolia HN Search API.

Features

ModeDescription
Top / New / BestScrape front-page, newest, or highest-voted stories
Ask HN / Show HNScrape community questions and project showcases
JobsScrape HN job postings
User ProfileScrape any user's karma, bio, and recent submissions
SearchFull-text search via Algolia (by relevance or date)
CommentsOptionally fetch top-level comments for each story

Input Parameters

ParameterTypeDefaultDescription
scrape_typestring"top"One of: top, new, best, ask, show, job, user, search
max_itemsinteger30Max stories to scrape (1–500)
include_commentsbooleanfalseFetch comments for each story
max_comments_per_storyinteger10Max top-level comments per story
min_scoreinteger0Only include stories with ≥ this score
usernamestring""HN username (required for user mode)
search_querystring""Search query (required for search mode)
search_sortstring"relevance"relevance or date

Example Input

{
"scrape_type":"top",
"max_items":30,
"include_comments":true,
"max_comments_per_story":5,
"min_score":50
}

Output Format

Each story item in the dataset looks like:

{
"id":12345678,
"rank":1,
"type":"story",
"title":"Show HN: My Cool Project",
"url":"https://example.com",
"hn_url":"https://news.ycombinator.com/item?id=12345678",
"score":342,
"author":"username",
"comments_count":87,
"created_at":"2026-04-04T10:30:00+00:00",
"time_ago":"3h ago",
"text":"",
"dead":false,
"deleted":false,
"scraped_at":"2026-04-04T14:00:00+00:00",
"comments":[
{
"id":12345679,
"story_id":12345678,
"type":"comment",
"author":"commenter",
"text":"Great project!",
"created_at":"2026-04-04T11:00:00+00:00",
"time_ago":"2h ago",
"parent":12345678,
"children":[12345680,12345681],
"dead":false,
"deleted":false
}
]
}

APIs Used

  • HN Firebase API: https://hacker-news.firebaseio.com/v0/ — Official, no auth needed
  • Algolia HN Search: https://hn.algolia.com/api/v1/ — Full-text search, no auth needed

License

ISC

You might also like

Hacker News Stories, Comments & Users Scraper

crawlerbros/hacker-news-scraper

Scrape Hacker News - search stories and comments, fetch top/new/best stories, get user profiles and submission history. Uses the official Algolia HN Search API and Hacker News Firebase API.

👁 User avatar

Crawler Bros

2

Hacker News Scraper

rupom888/hackernews-scraper

Scrape stories, jobs, comments, and polls from Hacker News using the official HN Firebase API. Get top/new/best/ask/show stories with comments, search by keyword via Algolia HN Search API. Reliable and no rate limiting.

2

Hacker News Scraper

nogards95/hacker-news-scraper

Scrape Hacker News stories, comments, jobs, Ask HN, and Show HN using Algolia Search API and HN Firebase API. Supports full-text search, date/points filters, and live feeds.

2

5.0

Hacker News Enhanced Scraper - Stories, Comments & Search

hata1234/hn-scraper

Scrape Hacker News stories, comments, and search results via official Firebase and Algolia APIs. No proxy needed. Supports top, best, new, Ask HN, Show HN, job stories, full-text search, comment extraction, and advanced filtering by points, date, and domain.

3

Hacker News Scraper

cloud9_ai/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles via official Firebase API. Get top, new, best, ask, show stories with scores, comments, and author data.

Hacker News Scraper

plantane/hackernews-scraper

Scrape stories, comments, and scores from Hacker News. Supports top, new, best, Ask HN, Show HN, and job feeds. Uses the official Firebase API for reliable, fast data extraction.

Hacker News MCP Server

automation-lab/hackernews-mcp-server

Query Hacker News data programmatically: search stories, get top posts, Ask HN, Show HN, jobs, comments, and user profiles via the free HN Algolia API.

👁 User avatar

Stas Persiianenko

3