VOOZH about

URL: https://apify.com/crawlerbros/lobsters-scraper

⇱ Lobsters Scraper · Apify

Pricing

from $3.00 / 1,000 results

Go to Apify Store

Lobsters Scraper

Scrape Lobsters (lobste.rs) â€" a curated tech link aggregator. Fetch hottest, newest, or tag-filtered stories with scores, comments, tags, and author info. No authentication required.

Pricing

from $3.00 / 1,000 results

Rating

0.0

(0)

Developer

👁 Crawler Bros

Crawler Bros

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

23 days ago

Last modified

Share

Scrape tech stories from Lobsters (lobste.rs) — a curated computing-focused link aggregator trusted by developers worldwide. Extract hottest and newest stories, or browse by technology tag with full metadata including scores, comment counts, author info, and direct links.

Features

  • Multiple feed modes: hottest stories, newest stories, or tag-filtered browsing
  • 25+ technology tags: programming, python, javascript, security, linux, networking, databases, AI, devops, and more
  • Full metadata: story title, URL, score, flag count, comment count, tags, submitter username, and timestamps
  • Pagination support: automatically fetches multiple pages up to your maxItems limit
  • No authentication required: uses the public lobste.rs JSON API

Use Cases

  • Monitor trending tech articles and discussions
  • Track community sentiment on specific technologies
  • Build developer-focused news aggregators
  • Research tech topics by community voting patterns
  • Competitive analysis of developer interest areas

Input

FieldTypeDescriptionDefault
modeSelectFeed type: hottest, newest, or byTaghottest
tagSelectTechnology tag to browse (mode=byTag). Options: programming, python, javascript, security, linux, networking, databases, ai, devops, etc.programming
maxItemsIntegerMaximum number of stories to return (1–500)25

Output

Each record contains:

FieldTypeDescription
shortIdStringUnique story ID on Lobsters
titleStringStory headline
urlStringLink to the original article
scoreIntegerUpvote count from community
flagsIntegerFlag count (moderation signal)
commentCountIntegerNumber of discussion comments
descriptionStringAuthor-provided description (if any)
tagsArrayTechnology tags applied to the story
submittedByStringUsername of the submitter
createdAtStringISO 8601 timestamp when posted
shortIdUrlStringPermanent story URL on lobste.rs
commentsUrlStringDirect link to comments thread
userIsAuthorBooleanWhether submitter is the content author
scrapedAtStringISO 8601 timestamp of when this record was scraped

Example Output

{
"shortId":"abc123",
"title":"Understanding Rust's Ownership Model",
"url":"https://example.com/rust-ownership",
"score":89,
"flags":0,
"commentCount":14,
"tags":["programming","rust"],
"submittedBy":"johndoe",
"createdAt":"2026-06-04T10:00:00.000-05:00",
"shortIdUrl":"https://lobste.rs/s/abc123",
"commentsUrl":"https://lobste.rs/s/abc123/understanding_rust_ownership",
"userIsAuthor":false,
"scrapedAt":"2026-06-04T15:30:00.000000+00:00"
}

FAQs

Does this require an API key? No. Lobsters provides a public JSON API at /hottest.json, /newest.json, and /t/<tag>.json without any authentication.

How many stories are returned per page? Lobsters always returns exactly 25 stories per page. Set maxItems to a multiple of 25 for best results.

Which tags are available? The dropdown includes 25 curated tags. For the full list, visit https://lobste.rs/tags.

Can I get comments text? This scraper returns story metadata only. Use the commentsUrl field to open the discussion thread.

How fresh is the data? Stories are fetched in real time directly from the Lobsters API. No caching.

You might also like

Lobsters Scraper | Tech News and Discussions

parseforge/lobsters-scraper

Scrape tech stories from Lobsters including titles, links, tags, scores, comment counts, submitters and timestamps. Build datasets of developer-focused news and discussions for trend analysis, content curation and technology research projects at scale across the full catalog

2

Lobsters Scraper

epctex/lobsters-scraper

Scrape Lobste.rs posts and users based on any search criteria. Retrieve all the comments, domains, tags, titles, number of upvotes, and published dates. Use this extremely fast actor to retrieve all the information right away. Easy use and no limits!

Helloworld.Rs Scraper

unfenced-group/helloworld-rs-scraper

Extract IT job listings from HelloWorld.rs, Serbia's largest IT job board. Supports keyword, location, tech tag, seniority, and work type filters. Returns full descriptions, structured salary data, and tech tags.

👁 User avatar

Unfenced Group

8

Reddit Subreddit Scraper

codingfrontend/reddit-subreddit-scraper

Scrape the newest, hottest, top, or rising posts from any Reddit subreddit with full metadata, images, videos, awards, and optional comments.

👁 User avatar

Coding Frontned

2