VOOZH about

URL: https://apify.com/fortuitous_pirate/data-gov-catalog-scraper

⇱ Data Gov Catalog Scraper · Apify

👁 Data Gov Catalog Scraper avatar

Data Gov Catalog Scraper

Pricing

from $3.50 / 1,000 results

Go to Apify Store

Data Gov Catalog Scraper

Search, filter, and download metadata for 300,000+ federal open datasets from Data.gov. Filter by agency (NASA, EPA, NOAA), format (CSV, JSON, API), tags, and topics. Returns dataset details, resource links, and organization info.

Pricing

from $3.50 / 1,000 results

Rating

0.0

(0)

Developer

👁 Fortuitous Pirate

Fortuitous Pirate

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a month ago

Last modified

Share

Data.gov Federal Dataset Catalog

Overview

Search and discover 300,000+ federal open datasets from Data. gov. Filter by agency, format, tags, topics, and keywords.

Features

  • Search by keywords to find specific results
  • Filter results by category or type
  • Export data in JSON, CSV, or Excel formats
  • Control output volume with configurable result limits
  • Built-in proxy support for reliable data collection

Use Cases

  • Track - Track federal government data releases and updates
  • Build - Build datasets for policy research and analysis
  • Monitor - Monitor regulatory changes and compliance requirements
  • Aggregate - Aggregate public government data for transparency projects

Input Parameters

ParameterTypeDescriptionDefault
searchQuerystringKeyword search across dataset titles, descriptions, and metadata (e.g., "clim...
organizationstringFilter by federal agency slug (e.g., "nasa", "epa", "noaa", "census-gov", "us...
formatstringFilter datasets by resource format.``
tagsstringFilter by tag (e.g., "climate", "health", "transportation"). Single tag per q...
topicstringFilter by group/topic (e.g., "agriculture8571", "climate5434", "health3702")....
sortBystringSort order for results.relevance
maxItemsintegerMaximum number of datasets to return.100
proxyConfigurationobjectProxy configuration for requests. Usually not needed for this public API.

Output Example

Each result contains structured data like this:

{
"title":"Sample Government - Federal Result",
"organization":"Sample organization",
"numResources":"Sample numResources",
"tags":"Sample tags",
"metadataModified":"Sample metadataModified",
"licenseTitle":"Sample licenseTitle",
"url":"https://example.com/item/12345"
}

Pricing

This actor uses pay-per-result pricing:

  • $0.001 per result
  • $1.00 per 1,000 results

No monthly fees. You only pay for what you scrape. Apify Free plan includes $5/month in platform credits.

How to Run

Apify Console

  1. Go to the Data.gov Federal Dataset Catalog actor page
  2. Configure your input parameters
  3. Click Start and wait for the results
  4. Download data in JSON, CSV, or Excel format

API

curl-X POST "https://api.apify.com/v2/acts/fortuitous_pirate~data-gov-catalog-scraper/runs?token=YOUR_API_TOKEN"\
-H"Content-Type: application/json"\
-d'{"maxItems": 10}'

Python SDK

from apify_client import ApifyClient
client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("fortuitous_pirate/data-gov-catalog-scraper").call(
 run_input={"maxItems":10}
)
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)

Integration

Connect Data.gov Federal Dataset Catalog with your existing tools and workflows:

  • API access - Programmatic access via Apify API
  • Webhooks - Get notified when scraping completes
  • Scheduling - Set up recurring runs on any schedule
  • Zapier / Make - Connect with 5,000+ apps via Apify integrations
  • Python / Node.js SDKs - Native client libraries for easy integration

You might also like

Data.gov Catalog Scraper

crawlerbros/data-gov-catalog-scraper

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

👁 User avatar

Crawler Bros

2

Data.gov API - US Open Government Datasets

alizarin_refrigerator-owner/data-gov-api---us-open-government-datasets

Access the Data.gov catalog of 300,000+ US government datasets. Search datasets by topic, agency, format, and keywords. Discover open data from federal, state, and local governments

👁 User avatar

The Howlers

3

Data.gov Dataset Catalog Crawler

jungle_synthesizer/datagov-dataset-crawler

Crawl 300K+ US government datasets from Data.gov. Extract titles, organizations, tags, formats, download URLs, API endpoints, temporal and spatial coverage, contacts, and resources. Filter by agency, format, category, and tags.

👁 User avatar

BowTiedRaccoon

2

Australia Open Data (data.gov.au) Scraper

parseforge/australia-data-gov-au-scraper

Export Australian government open datasets from data.gov.au. Browse 70k+ datasets across federal, state, and territory agencies. Pull dataset metadata, resources, organization, license, tags, and update frequency. Catalog mode lists all; dataset mode fetches one by ID.

2

Data.gov.uk Scraper - Low-cost💲🔥📚🇬🇧

delectable_incubator/data-gov-uk-scraper-low-cost

Scrape data.gov.uk dataset listings 🔎📊 with a powerful open data scraper. Extract dataset titles, publishers, update dates, descriptions, tags, and dataset URLs from search results. Ideal for government data monitoring, open data research, dataset discovery, and structured data catalog creation 🚀

👁 User avatar

Prime Scrape

2

Gov Contracts Scraper

labrat011/gov-contracts-scraper

Search U.S. federal contract opportunities, awards, and agencies from SAM.gov. Filter by keyword, NAICS code, set-aside type, state, agency, and more. Returns structured data including contacts, deadlines, award amounts, and direct SAM.gov links. Requires a free SAM.gov API key.

France Data.gouv.fr Scraper | French Open Data Catalog

parseforge/france-data-gouv-scraper

Export the French government open data catalog: dataset title, slug, description, organization, license, tags, created date, last modified, resources count and download URL. Search by keyword or filter by organization. CSV, Excel, JSON, XML for research and policy analysis.

2

Canada Open Data Catalog Scraper

parseforge/canada-open-data-scraper

Export Canadian government open datasets from open.canada.ca. Browse 36k+ datasets across federal departments. Pull dataset metadata, resources, organization, license, tags, and publication dates. Catalog mode lists all datasets; dataset mode fetches one by ID.

2

Gov Grants Federal Scraper

crawlerbros/gov-grants-federal-scraper

Scrape federal grant opportunities from Grants.gov - search by keyword, agency, status, or category. Returns full opportunity metadata: award amounts, deadlines, agency, CFDA numbers, eligibility, and synopsis. Uses the public Grants.gov v1 search API. No login required.

👁 User avatar

Crawler Bros

1