Pricing

Rating

Developer

Actor stats

Categories

Share

👁 ParseForge Banner

💼 Indie Hackers Posts Scraper

🚀 Pull every Indie Hackers post URL with section, ID, and decoded title. Discovered via the official sitemap. No login, no API key, no manual scrolling.

🕒 Last updated: 2026-05-01 · 📊 6 fields per post · 💼 47,000+ posts indexed · 🏗️ founder-driven community · 🆓 sitemap-based discovery

The Indie Hackers Posts Scraper discovers every post URL from the official Indie Hackers sitemap and returns slug, section, post ID, decoded title, URL, and scrape timestamp. The sitemap covers more than 47,000 posts across founder stories, startup advice, product launches, and community discussions.

Indie Hackers is the largest community of bootstrapped founders sharing revenue numbers, growth tactics, and lessons learned. The post archive is a primary research surface for product-market-fit research, content marketing inspiration, and founder interviews. This Actor exposes the full post catalog as structured data with optional keyword filtering.

📋 What the Indie Hackers Posts Scraper does

Three filtering workflows in a single run:

• 📑 Full sitemap discovery. Walks the Indie Hackers sitemap index across 5 sub-sitemaps and aggregates 47k+ post URLs.
• 🔍 Keyword filter. Substring match on the URL slug to narrow to a topic.
• 🏷️ Section detection. Each post URL embeds a section (creators, starting-up, building, etc.) which is parsed into a separate field.

Each row reports the post URL, slug, section, post ID (16-character suffix on the slug), title decoded from the kebab-case slug, and a scrape timestamp.

💡 Why it matters: Indie Hackers is built on the assumption that founders learn best from each other's open lessons. The post archive is therefore unusually high signal per row: revenue numbers, traction strategies, hiring stories, pricing experiments. Researchers cite IH posts in startup studies. Content marketers mine IH for proven angles. This Actor turns the open archive into structured rows you can filter and analyze.

🎬 Full Demo

🚧 Coming soon: a 3-minute walkthrough showing how to go from sign-up to a downloaded dataset.

⚙️ Input

Example: 100 posts that mention pricing.

{
"maxItems":100,
"keywordFilter":"pricing"
}

Example: 1,000 most recent posts across all topics.

{
"maxItems":1000
}

⚠️ Good to Know: Indie Hackers post pages are client-rendered Ember and the per-post HTML does not return body content from a plain HTTP fetch. This Actor is intentionally scoped to the URL list plus title decoded from the slug. Body content extraction would need a headless browser and is out of scope for v1.

📊 Output

Each post record contains 6 fields. Download as CSV, Excel, JSON, or XML.

🧾 Schema

📦 Sample records

✨ Why choose this Actor

📊 In a single 6-second run the Actor returned 100 post URLs from the live Indie Hackers sitemap.

📈 How it compares to alternatives

Same sitemap Indie Hackers itself publishes for search engines, exposed as structured rows.

🚀 How to use

1. 🆓 Create a free Apify account. Sign up here and get $5 in free credit.
2. 🔍 Open the Actor. Search for "Indie Hackers Posts" in the Apify Store.
3. ⚙️ Set the keyword filter. Optional. Leave empty for the full archive.
4. ▶️ Click Start. A 100-post run finishes in under 10 seconds.
5. 📥 Download. Export as CSV, Excel, JSON, or XML.

⏱️ Total time from sign-up to first dataset: under five minutes.

💼 Business use cases

🌟 Beyond business use cases

Data like this powers more than commercial workflows. The same structured records support research, education, civic projects, and personal initiatives.

🔌 Automating Indie Hackers Posts Scraper

Run this Actor on a schedule, from your codebase, or inside another tool:

• Node.js SDK: see Apify JavaScript client for programmatic runs.
• Python SDK: see Apify Python client for the same flow in Python.
• HTTP API: see Apify API docs for raw REST integration.

Schedule daily runs from the Apify Console to track new posts. Pipe results into Google Sheets, S3, BigQuery, or your own webhook with the built-in integrations.

🤖 Ask an AI assistant about this scraper

Open a ready-to-send prompt about this ParseForge actor in the AI of your choice:

• 💬 ChatGPT
• 🧠 Claude
• 🔍 Perplexity
• 🅒 Copilot

❓ Frequently Asked Questions

📑 What sections are covered?

Every section IH publishes including creators, starting-up, building, ideas, growth, no-code, money, monetization, AI, and more. The section name is parsed directly from the URL.

📝 Does it return post body content?

No. Indie Hackers post pages are fully client-rendered Ember; a plain HTTP fetch returns the homepage shell. This Actor returns URL plus slug-decoded title only. Full body content would need browser automation.

🆔 What is the postId?

The 16-character alphanumeric suffix at the end of every Indie Hackers post slug. It is stable, unique, and works as a primary key across runs.

🔍 How does keywordFilter work?

Substring match against the URL slug, case-insensitive. Pass pricing to find posts whose slug contains pricing. Leave empty for the full archive.

📅 How recent are the posts?

The sitemap is updated frequently and includes posts up to the most recent ones. Each run hits the live sitemap.

📦 How many posts can I pull?

Free plan caps at 10. Paid plans go up to 1,000,000. The sitemap currently holds more than 47,000 posts in total.

🔠 Why is the title in title-case-of-kebab?

The title is decoded from the URL slug because the per-post HTML does not return the original headline reliably. Capitalization is title case. The original author headline may differ in style.

💼 Can I use this for commercial work?

Yes. The Actor reads only the public sitemap that Indie Hackers publishes for search engines. Always honor IH's terms when republishing content.

💳 Do I need a paid Apify plan?

The free plan returns up to 10 posts per run. Paid plans return up to 1,000,000.

⚠️ What if a run fails?

The most likely cause is a temporary sitemap fetch failure. Retry once. If the issue persists, open a contact form and include the run URL.

🔁 How fresh is the data?

Live. Each run hits the IH sitemap at run time.

⚖️ Is this legal?

Yes. The Actor reads the publicly published sitemap that IH explicitly serves to search engines for indexing. It does not bypass any access control.

🔌 Integrate with any app

• Make - drop run results into 1,800+ apps.
• Zapier - trigger automations off completed runs.
• Slack - post run summaries to a channel.
• Google Sheets - sync each run into a spreadsheet.
• Webhooks - notify your own services on run finish.
• Airbyte - load runs into Snowflake, BigQuery, or Postgres.

🔗 Recommended Actors

• 📰 Substack Publication Scraper - founder-friendly newsletter archive scraper.
• 🐝 Beehiiv Newsletter Scraper - the same workflow for Beehiiv-hosted newsletters.
• 🐙 GitHub Trending Repos Scraper - pair founder posts with developer-attention data.
• 📚 Wikipedia Pageviews Scraper - cross-reference founder topics with public-interest spikes.
• 🅱️ Bing Search Scraper - track which IH posts rank for which keywords.

💡 Pro Tip: browse the complete ParseForge collection for more pre-built scrapers and data tools.

🆘 Need Help? Open our contact form and we'll route the question to the right person.

Indie Hackers is a registered trademark of Stripe, Inc. This Actor is not affiliated with or endorsed by Indie Hackers or Stripe. It reads only the publicly published sitemap.