VOOZH about

URL: https://apify.com/skystone_labs/hackernews-scraper

โ‡ฑ Hacker News Scraper - Extract Stories, Comments & User Data ยท Apify

Pricing

from $1.00 / 1,000 item scrapeds

Go to Apify Store

Extract stories, comments, and user data from Hacker News. Get titles, URLs, scores, comment counts, authors, and timestamps. Perfect for tech trend analysis, content research, and developer community insights.

Pricing

from $1.00 / 1,000 item scrapeds

Rating

0.0

(0)

Developer

๐Ÿ‘ Skystone

Skystone

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 months ago

Last modified

Share

Hacker News Scraper

Extract stories, comments, and discussion data from Hacker News. Pay only for successfully scraped items ($1 per 1,000 items).

Features

  • Fast extraction - Optimized for speed with lightweight page parsing
  • Story data - Titles, links, scores, authors, comment counts
  • Comment extraction - Optional full comment thread scraping
  • Type detection - Identifies stories, Ask HN, Show HN, and jobs
  • Pagination - Automatically follows "More" links for deeper scraping

Use Cases

  • Tech trend analysis and monitoring
  • Content research for newsletters
  • Developer community sentiment analysis
  • Startup and launch tracking
  • Academic research on tech communities

Input Parameters

ParameterTypeDefaultDescription
startUrlsarray-HN URLs to scrape (front page, new, ask, show, jobs)
maxResultsinteger100Maximum items to scrape (0 = unlimited)
extractCommentsbooleanfalseExtract comment threads from stories
useCamoufoxbooleanfalseEnable anti-detect browser (not needed for HN)

Output Schema

{
"url":"https://news.ycombinator.com/item?id=12345",
"title":"Show HN: My new open source project",
"link":"https://github.com/example/project",
"score":234,
"author":"pg",
"commentCount":89,
"age":"3 hours ago",
"rank":1,
"type":"show",
"scrapedAt":"2024-01-15T10:30:00.000Z"
}

Pricing

$0.001 per successfully scraped item ($1 per 1,000 items)

No charges for failed requests.

Example Usage

{
"startUrls":[
{"url":"https://news.ycombinator.com/"},
{"url":"https://news.ycombinator.com/newest"}
],
"maxResults":200,
"extractComments":false
}

Limitations

  • HN may rate-limit very aggressive scraping
  • Comment extraction increases scraping time significantly
  • Very old stories may have limited data

Support

For issues or feature requests, please contact SkyStone Labs support.

You might also like

Hacker News Scraper - Stories & Comments

pear_fight/hackernews-scraper

Scrape Hacker News stories, comments & user profiles. Extract titles, URLs, scores, comment counts, timestamps, full comment threads. Monitor trending tech topics in real time. Pay per result. Export JSON/CSV.

Hackernews Intelligence

viralanalyzer/hackernews-intelligence

Scrape Hacker News stories, comments, and discussions. Track tech trends, startup news, and developer community sentiment.

5

5.0

Hacker News Scraper

gentle_cloud/hacker-news-scraper

Scrape Hacker News stories, comments, and user data. Supports top/new/best/ask/show/job story feeds and full-text keyword search via the Algolia API. Extract titles, URLs, scores, authors, comment counts, and timestamps.

57

HackerNews Scraper

gio21/hackernews-scraper

Scrape Hacker News posts, stories, and comments. Extract titles, scores, authors, URLs, and discussion data from the front page, new, best, ask, show, and jobs sections.

Hacker News Scraper โ€” Stories, Comments & Jobs

cryptosignals/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles โ€” extract title, URL, score, author, comment threads, and submission time. CSV/JSON output.

6

Hacker News Scraper

cloud9_ai/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles via official Firebase API. Get top, new, best, ask, show stories with scores, comments, and author data.