VOOZH about

URL: https://apify.com/parseforge/kapsarc-energy-data-scraper

โ‡ฑ KAPSARC Energy Data Scraper ยท Apify


Pricing

from $7.50 / 1,000 results

Go to Apify Store

KAPSARC Energy Data Scraper

Pull energy datasets straight from the KAPSARC catalog by passing a dataset id like india crude oil indicators. Supports full text search, field refinements, and sort order. Returns the raw record fields published by KAPSARC. Useful for energy research and policy analysis.

Pricing

from $7.50 / 1,000 results

Rating

0.0

(0)

Developer

๐Ÿ‘ ParseForge

ParseForge

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

14 days ago

Last modified

Share

๐Ÿ‘ ParseForge Banner

KAPSARC Energy Data Scraper

๐Ÿš€ Export KAPSARC energy datasets in seconds. Production, consumption, trade flows, and price indicators from KAPSARC public catalog.

๐Ÿ•’ Last updated: 2026-06-05 . ๐Ÿ“Š 6 fields per record . Public API . Real-time

The KAPSARC Energy Data Scraper turns the datasource.kapsarc.org public REST endpoint into a clean, structured dataset.

๐ŸŽฏ Target Audience๐Ÿ’ก Primary Use Cases
๐Ÿ“Š Energy analystsPull oil and gas indicators
๐Ÿ’ผ Policy teamsSnapshot energy trade flows
๐Ÿค– ML engineersBuild training sets on energy data
๐Ÿ“ฐ JournalistsVerify policy figures

๐Ÿ“‹ What the KAPSARC Energy Data Scraper does

๐Ÿ’ก Why it matters. The source returns raw API payloads that most data tools cannot ingest directly. This actor normalizes everything into a flat row format ready for analysis.

๐ŸŽฌ Full Demo

๐Ÿšง Coming soon.

โš™๏ธ Input

FieldTypeRequiredDescription
maxItemsintegerNoFree users limited to 10. Paid users up to 1,000,000. Prefill 10.

Example 1.

{
"dataset":"india-crude-oil-indicators",
"maxItems":100
}

Example 2.

{
"dataset":"india-crude-oil-indicators",
"q":"refinery",
"maxItems":50
}

โš ๏ธ Good to Know. This actor uses a public endpoint. No login or API key is required.

๐Ÿ“Š Output

FieldTypeDescription
๐Ÿ“ datasetidstringKAPSARC dataset id.
๐Ÿ†” recordidstringUnique record id.
๐Ÿ•’ recordTimestampstringRecord timestamp from upstream.
๐Ÿ“Š fieldsobjectFlattened upstream fields.
๐Ÿ•’ scrapedAtstringWhen this row was fetched.
โŒ errorstringSet if upstream returned an error.

Sample record.

{
"datasetid":"india-crude-oil-indicators",
"recordid":"abc123",
"recordTimestamp":"2025-11-09T10:24:58.941Z",
"fields":{
"obs_value":"0.0",
"energy_product_name":"Total",
"flow_breakdown":"Refinery intake",
"time_period":"2016-11-01",
"unit_measure":"CONVBBL"
},
"scrapedAt":"2026-06-05T12:00:00.000Z",
"error":null
}

โœจ Why choose this Actor

| ๐Ÿ†“ | Public source, no API key required. | | ๐Ÿงน | Clean snake_case fields ready for BI tools. | | ๐Ÿ”ข | Numeric values auto-cast for spreadsheets. | | ๐Ÿ›Ÿ | Errors surfaced as a clean record instead of crashing. | | ๐Ÿ’พ | Push to dataset for instant export in multiple formats. |

๐Ÿ“ˆ How it compares to alternatives

ApproachSetup timeClean fields?Numeric casting?
Roll your own fetch30 min+โŒโŒ
Custom Python script1 hr+partialpartial
This Actor5 sec, no installโœ…โœ…

๐Ÿš€ How to use

  1. Click Try for free.
  2. Adjust maxItems if needed (defaults to 10).
  3. Click Start. Within seconds, your dataset is ready for download or integration.

๐Ÿ’ผ Business use cases

๐Ÿ“Š Analytics dashboards. Pipe results into BI tools.

๐Ÿ’ผ Backtesting. Snapshot data daily for reproducible analysis.

๐Ÿ“ฐ Reporting. Embed live numbers in newsletters or briefings.

๐Ÿค– ML feature engineering. Build training sets from public data.

๐Ÿ”Œ Automating KAPSARC Energy Data Scraper

  • Make / Zapier. Trigger this actor on a schedule, push results to Airtable, Google Sheets, or Slack.
  • Cron schedule. Native Apify scheduler.
  • Webhooks. POST to your endpoint when a run finishes.
  • Pipe to BigQuery, Snowflake, Postgres. Native Apify integrations.

๐ŸŒŸ Beyond business use cases

๐ŸŽ“ Education. Use real data in finance and economics classes.

๐Ÿงช Personal research. Track your own metrics without coding.

๐Ÿค Non-profit and open data. Build public dashboards with current numbers.

๐Ÿงฐ Tinkering and prototyping. Spin up a feed in seconds for new ideas.

๐Ÿค– Ask an AI assistant about this scraper

Pop this README into ChatGPT, Claude, or any AI assistant and ask it to map your workflow to the actor inputs.

โ“ Frequently Asked Questions

โ“ Do I need an API key? No. KAPSARC datasource is fully public.

โ“ Where do I find dataset ids? Browse the KAPSARC catalog at datasource.kapsarc.org/explore/.

โ“ Can I filter by year or country? Yes, use the refineKey and refineValue inputs.

โ“ Will the schema change? datasetid, recordid, recordTimestamp, and fields are stable.

โ“ Can I schedule runs? Yes via Apify scheduler, Make, Zapier, or cron.

โ“ Is this scraping or API? API. KAPSARC search endpoint is public and stable.

โ“ What if upstream returns an error? A single record with error populated is pushed.

โ“ Can I run heavy backfills? Yes on a paid plan up to 1,000,000 items.

โ“ Which export formats are available? Apify dataset UI exposes multiple structured formats.

โ“ Is rate limiting strict? KAPSARC is generous with public traffic.

๐Ÿ”Œ Integrate with any app

Apify ships native integrations with Make, Zapier, Slack, Discord, Google Drive, Google Sheets, Gmail, Airbyte, Keboola, Telegram, GitHub, and any REST API or webhook endpoint.

๐Ÿ”— Recommended Actors

ActorWhat it does
ParseForge Alpha Vantage ScraperStocks, FX, crypto, and indicators.
ParseForge OurAirports ScraperGlobal airport database.
ParseForge NBA Stats ScraperPlayer and team stats from NBA.com.
ParseForge CurseForge Mods ScraperPublic mod metadata from CurseForge.

๐Ÿ’ก Pro Tip. Browse the complete ParseForge collection for 900+ production-grade scrapers.


Disclaimer. This actor scrapes only publicly available data. ParseForge is not affiliated with, endorsed by, or sponsored by any of the third-party services referenced. Users are responsible for complying with the target site terms of service and applicable law. Create a free account w/ $5 credit.

You might also like

Energy Market Notices & Reports

datapilot/energy-market-notices-reports

Energy Notice Scraper collects real-time energy alerts from RSS feeds including U.S. Energy Information Administration, National Grid, Reuters, and International Energy Agency. It filters by keyword, extracts notice details, and outputs structured JSON for monitoring global energy market updates.

EIA US Energy Data Search

ryanclinton/eia-energy-data

US energy data from the Energy Information Administration: electricity prices, natural gas, petroleum, and state energy profiles.

EIA Energy Data Scraper

parseforge/eia-energy-data-scraper

Scrape US energy prices from the Energy Information Administration. Get weekly crude oil spot prices, gasoline prices by state, and diesel prices by region. Includes current, historical, and year-over-year price comparisons.

US Energy.gov Data Scraper

parseforge/energy-gov-scraper

Scrape energy-related content from Energy.gov, including articles, press releases, documents, titles, dates, offices, and types. Automate collection of structured data from the U.S. Department of Energy, ideal for researchers, journalists, and professionals needing accurate, up-to-date information.

EIA Energy Data Scraper - US Energy Prices & Stats

compute-edge/eia-energy-scraper

Extract energy data from the US EIA API. Access petroleum prices, natural gas, coal, electricity, nuclear outages, and state energy data. 14 data categories with pagination, facet filtering, and date range support.

5

5.0

EPREL Product Energy Label Scraper

eloquent_mountain/eprel-product-data-scraper

Extracts detailed energy efficiency data, product sheets (PIS), and energy labels from the official EU EPREL database.

Energy Transition Intelligence MCP Server

ryanclinton/energy-transition-intelligence-mcp

Energy market and grid risk intelligence via the Model Context Protocol.

Oil And Gas Company Email Scraper

contacts-api/oil-and-gas-company-email-scraper

Oil and gas company email scraper to extract verified emails from oil producers, gas companies, energy firms, and industry directories ๐Ÿ“งโ›ฝ Perfect for B2B lead generation, partnerships, and energy sector outreach. Fast, accurate, and scalable.

Related articles

Dataset processing on Apify
Read more