VOOZH about

URL: https://apify.com/parseforge/metaculus-questions-scraper

โ‡ฑ Metaculus Questions Scraper ยท Apify


Pricing

from $7.50 / 1,000 results

Go to Apify Store

Metaculus Questions Scraper

Browse forecasting questions on Metaculus filtered by status, sort, or free text search. Each question carries id, title, category, status, close_time, community_prediction, and num_predictions. Useful for AI safety research, geopolitics tracking, and forecast aggregation.

Pricing

from $7.50 / 1,000 results

Rating

0.0

(0)

Developer

๐Ÿ‘ ParseForge

ParseForge

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a month ago

Last modified

Share

๐Ÿ‘ ParseForge Banner

๐Ÿ”ฎ Metaculus Questions Scraper

๐Ÿš€ Export Metaculus forecasting questions in seconds, including community predictions, prediction counts, categories, and resolution dates, straight from the public api2 endpoint.

๐Ÿ•’ Last updated: 2026-05-29 ยท ๐Ÿ“Š 12 fields per record ยท 50,000+ Metaculus questions ยท Crowdsourced forecasting

The Metaculus Questions Scraper turns the Metaculus public api2/questions/ endpoint into a clean dataset. It walks the cursor-paginated feed, filters by status and free-text search, and emits one row per question with the community median prediction, category, and timing.

๐ŸŽฏ Target Audience๐Ÿ’ก Primary Use Cases
๐Ÿ”ฎ ForecastersCalibration & track records
๐Ÿ“Š ResearchersWisdom-of-crowds datasets
๐Ÿข Hedge fundsTail-risk signal monitoring
๐Ÿค– ML researchersForecast aggregation training
๐Ÿ“ฐ JournalistsReal-world probability quotes
๐Ÿ‘ฉโ€๐Ÿ’ป DevelopersMirror Metaculus locally

๐Ÿ“‹ What the Metaculus Questions Scraper does

  • Calls https://www.metaculus.com/api2/questions/ with status, search, and ordering filters.
  • Walks pagination until maxItems is reached.
  • Extracts community median prediction, prediction count, categories, close & resolve times.
  • Exports as CSV, Excel, JSON, JSONL, XML, RSS, or HTML.

๐Ÿ’ก Why it matters: Metaculus is the largest serious forecasting community on the internet. Their community predictions are battle-tested calibration sources.

๐ŸŽฌ Full Demo

๐Ÿšง Coming soon.

โš™๏ธ Input

FieldTypeRequiredDescription
maxItemsintegerNoFree 10, paid up to 1M.
statusenumNoopen, closed, resolved, all.
searchstringNoFull-text query.
orderByenumNoSort order.

Example 1:

{"status":"open","orderBy":"-vote_score","maxItems":50}

Example 2:

{"search":"AI","status":"open"}

โš ๏ธ Good to Know: The Metaculus api2 endpoint is public. No key required.

๐Ÿ“Š Output

FieldTypeDescription
๐Ÿ†” idnumberQuestion ID.
๐Ÿ“› titlestringQuestion title.
๐Ÿ”— urlstringPublic URL.
๐ŸŸข statusstringopen/closed/resolved.
๐Ÿท๏ธ categorystringComma-joined categories.
โฐ close_timestringWhen forecasting closes.
๐Ÿ”ฎ community_predictionnumberCommunity median (q2).
๐Ÿงฎ num_predictionsnumberTotal predictions count.
๐Ÿ•’ scrapedAtstringWhen fetched.
โŒ errorstringError if upstream failed.

Sample record:

{
"id":12345,
"title":"Will AGI be declared before 2030?",
"url":"https://www.metaculus.com/questions/12345/",
"status":"open",
"category":"AI, Tech",
"close_time":"2029-12-31T23:59:00Z",
"community_prediction":0.18,
"num_predictions":4521,
"scrapedAt":"2026-05-29T13:00:00.000Z",
"error":null
}

โœจ Why choose this Actor

| ๐Ÿ†“ | Public Metaculus api2, no key. | | ๐Ÿ”ฎ | Pulls community median directly. | | ๐Ÿ”ข | Numeric casting on every numeric field. | | ๐Ÿ›Ÿ | Errors surfaced cleanly. | | ๐Ÿ”Œ | Status, search, sort filters. | | ๐Ÿ’พ | CSV / Excel / JSON / XML / RSS / HTML. |

๐Ÿ“ˆ How it compares to alternatives

ApproachSetupPagination?Filter?Errors?
Raw fetch20 minmanualmanualโŒ
Custom scraper1 hrโœ…partialpartial
This Actor5 secโœ…โœ…โœ…

๐Ÿš€ How to use

  1. Click Try for free.
  2. Pick a status / search.
  3. Click Start.

๐Ÿ’ผ Business use cases

๐Ÿ“Š Tail-risk monitoring. Watch AI, geopolitics, biosecurity questions for tail signals.

๐Ÿ’ผ Calibration research. Build calibration plots vs Metaculus community.

๐Ÿ“ฐ Newsroom. Quote crowd probabilities in stories.

๐Ÿค– ML. Train forecast aggregation models.

๐Ÿ”Œ Automating Metaculus Questions Scraper

  • Make / Zapier to Airtable / Slack.
  • Cron schedule native Apify.
  • Webhooks on completion.
  • Pipe to BigQuery / Snowflake / Postgres.

๐ŸŒŸ Beyond business use cases

๐ŸŽ“ Education. Teach forecasting / Bayesian inference.

๐Ÿงช Personal research. Track your interest area.

๐Ÿค Open data. Public forecast dashboards.

๐Ÿงฐ Prototyping. Quick feed.

๐Ÿค– Ask an AI assistant about this scraper

Drop this README into ChatGPT or Claude.

โ“ Frequently Asked Questions

โ“ API key? None.

โ“ Pagination? Cursor-paginated, fully walked.

โ“ Filter? Yes - status, search, sort.

โ“ Cast? Yes.

โ“ Errors? Clean {error} record.

โ“ Schedule? Yes.

โ“ Scraping or API? Public api2.

โ“ Schema stable? Yes.

โ“ Formats? CSV, Excel, JSON, JSONL, XML, RSS, HTML.

โ“ Coverage? All Metaculus questions.

๐Ÿ”Œ Integrate with any app

Apify integrations with Make, Zapier, Slack, Discord, Google Drive, Google Sheets, Gmail, Airbyte, Keboola, Telegram, GitHub, REST/webhook.

๐Ÿ”— Recommended Actors

ActorWhat it does
ParseForge PredictIt Markets ScraperPolitical prediction markets.
ParseForge The Odds API Sports ScraperSports betting markets.
ParseForge Stocktwits Trending Symbols ScraperRetail sentiment.
ParseForge Alpha Vantage Public ScraperStocks, FX, crypto.

๐Ÿ’ก Pro Tip: browse the complete ParseForge collection for 900+ scrapers.


Disclaimer: This actor scrapes only publicly available data. ParseForge is not affiliated with, endorsed by, or sponsored by any of the third-party services referenced. Users are responsible for complying with the target site's terms of service and applicable law. Create a free account w/ $5 credit.

You might also like

Quora Questions Spider

getdataforme/quora-questions-spider

The Quora Questions Spider is a tool for scraping questions from Quora based on user-defined queries. It extracts comprehensive data, including question texts and metadata, with customizable query options and item limits....

Quora Scraper

jungle_synthesizer/quora-scraper

Scrape Quora questions and answers by keyword search or direct question URLs. Extracts question title, answer text, author info, upvote counts, and engagement metrics. Supports bulk extraction with configurable result limits.

๐Ÿ‘ User avatar

BowTiedRaccoon

3

Sephora Reviews and Questions Scraper

scraped/sephora-reviews-and-questions-scraper

Scrape product reviews and questions and answers from Sephora

Keyword Opportunity Finder

trovevault/keyword-opportunity-finder

Find high-potential product and content opportunities from real Google search questions. The Keyword Opportunity Finder scrapes People Also Ask questions for any keyword, measures keyword difficulty via search counts, checks the Apify Store for existing actor coverage, and scores each question.

Prediction Markets Scraper - MCP Server

jan.turon/prediction-markets-scraper-mcp-server

Scrape live prediction market events, prices, and liquidity across 13 exchanges: Polymarket, Kalshi, Limitless, Metaculus, Smarkets, and more

3

Stack Overflow Scraper - Questions by Tag

logiover/stack-exchange-questions-scraper

Scrape Stack Overflow questions by tag without an API key. Stack Exchange data export to CSV/JSON; an API alternative for question datasets.

Stack Exchange Questions Scraper

gio21/stackexchange-questions-scraper

Scrape questions from any Stack Exchange site (Stack Overflow, Server Fault, Math.SE, Ask Ubuntu, etc.) by tag, intitle search, or sort (votes/activity/newest/hot). Returns title, score, answer count, views, owner, tags, link, dates. Pay per question returned.

Quora Scraper

sian.agency/quora-scraper

Scrape Quora questions and answers into clean datasets โ€” question text, answer & follower counts, topics, and top answers (author, credential, upvotes, views, text). Fast overview or full per-question detail. Engagement scoring built in. No account or API key needed.

๐Ÿ‘ User avatar

SIรN Oรœ

2