VOOZH about

URL: https://apify.com/klondikeking/hacker-news-scraper

โ‡ฑ Hacker News Scraper ยท Apify

Pricing

Pay per event

Go to Apify Store

Pricing

Pay per event

Rating

0.0

(0)

Developer

๐Ÿ‘ Pierrick McD0nald

Pierrick McD0nald

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a month ago

Last modified

Share

Hacker News Scraper โ€” Extract Stories, Comments & Engagement Data

Scrape Hacker News stories, comments, and engagement metrics using the official Algolia Search API. Filter by keywords, content type, date range, and sort order to get exactly the data you need for trend analysis, content curation, market research, and competitive intelligence.

Use Cases

  • Trend Analysis โ€” Track what technologies, products, or topics are gaining traction on Hacker News.
  • Content Curation โ€” Discover high-performing stories in your niche for newsletter curation or social sharing.
  • Market Research โ€” Monitor discussions about your product, competitor, or industry to gauge sentiment and interest.
  • Competitive Intelligence โ€” Identify which stories get the most engagement and understand what resonates with the HN community.
  • Academic Research โ€” Collect large datasets of tech community discussions for NLP, sentiment analysis, or social science research.

Input

FieldTypeRequiredDescription
searchQueriesArrayNoKeywords to search for. Leave empty to fetch top/front page stories.
tagsStringNoContent type filter: story, comment, poll, show_hn, ask_hn, front_page (default: story)
timeRangeStringNoFilter by time: all, last24h, lastWeek, lastMonth, lastYear (default: all)
sortByStringNoSort order: relevance, date, points (default: relevance)
maxItemsNumberNoMaximum results to return, 1โ€“1000 (default: 100)
proxyConfigurationObjectNoOptional proxy configuration for redundancy

Output

The Actor outputs a dataset with the following fields:

{
"objectID":"21530860",
"title":"John Carmack: I'm going to work on artificial general intelligence",
"url":"https://www.facebook.com/100006735798590/posts/2547632585471243/",
"author":"jbredeche",
"points":1574,
"numComments":889,
"createdAt":"2019-11-13T23:17:23Z",
"storyText":"",
"tags":["story","author_jbredeche","story_21530860"],
"searchQuery":"artificial intelligence"
}

Pricing

Pay per event: $0.001 per story scraped.

No hidden fees. You only pay for the data you extract. The Algolia Search API is free and public, so there are no additional API costs.

Limitations

  • Algolia HN Search API returns up to 1,000 hits per query.
  • Very old stories may not be indexed.
  • The API does not support sorting by points directly; sortBy: points falls back to relevance.
  • Rate limits are generous but not officially documented; the Actor uses conservative concurrency to avoid issues.

FAQ

Q: Do I need an API key? A: No. The Hacker News Algolia Search API is completely free and requires no authentication.

Q: Can I scrape comments instead of stories? A: Yes. Set tags to comment to extract comments matching your search queries.

Q: How far back does the data go? A: The Algolia index covers the full history of Hacker News, but very old items may have incomplete metadata.

Q: What happens if I reach my spending limit? A: The Actor stops gracefully and saves all data collected up to that point.

Changelog

  • v1.0.0 โ€” Initial release with search, filtering, and pagination support.

You might also like

Hacker News Top Sites Scraper

fearless_sharpener/hacker-news-top-sites-scraper

Unlock even more valuable insights from the popular news website, Hacker News. Our updated Top Sites Scraper extracts titles, scores, links and more, all in one easy-to-use Apify actor. With this powerful tool, you can gather comprehensive data from Hacker News and gain a competitive edge.

Hacker News Data Scraper & Activity Monitoring

lucen_data/hacker-news-data-scraper-activity-monitoring

Unofficial Hacker News API to extract data from all Hacker News categories. You can filter posts based on specific keywords, track trends using the unique activity monitoring feature, and receive updates directly in your Slack channel.

Hacker News Stories, Comments & Users Scraper

crawlerbros/hacker-news-scraper

Scrape Hacker News - search stories and comments, fetch top/new/best stories, get user profiles and submission history. Uses the official Algolia HN Search API and Hacker News Firebase API.