VOOZH about

URL: https://apify.com/parseforge/data-gov-uk-scraper

⇱ Data.gov.uk Scraper - Extract UK Government Open Data Β· Apify


Pricing

Pay per event

Go to Apify Store

Data.gov.uk Scraper

Collect UK government open data effortlessly. Extract datasets, publishers, formats, topics, licenses, and download links from data.gov.uk β€” the official UK open data portal. Perfect for researchers, policy analysts, and developers building data catalogs.

Pricing

Pay per event

Rating

5.0

(1)

Developer

πŸ‘ ParseForge

ParseForge

Maintained by Community

Actor stats

0

Bookmarked

9

Total users

1

Monthly active users

22 days ago

Last modified

Categories

Share

πŸ‘ ParseForge Banner

πŸ‡¬πŸ‡§ Data.gov.uk Scraper

πŸš€ Collect open dataset metadata from Data.gov.uk in minutes. Search by keyword, publisher, or topic. Export dataset titles, descriptions, download links, and publisher info. No coding, no account required.

πŸ•’ Last updated: 2026-04-23 Β· πŸ“Š 20+ fields per dataset Β· πŸ” 3 search filters Β· πŸ“‚ Publisher + topic Β· 🚫 No auth required

Pull structured records from Data.gov.uk β€” clean fields ready as CSV, JSON, JSONL, Excel, or XML for downstream pipelines.
Related Scrapers
 UK data.gov.uk
➸ You are here
 USA data.gov
US federal open data
 Korea data.go.kr
Korean open gov data

Copy to your AI assistant

Copy this block into ChatGPT, Claude, Cursor, or any LLM to start using this actor.

parseforge/data-gov-uk-scraper on Apify. Call:ApifyClient("TOKEN").actor("parseforge/data-gov-uk-scraper").call(run_input={...}), then client.dataset(run["defaultDatasetId"]).list_items().items for results. Key inputs:startUrl(string),maxItems(integer,default10),searchQuery(string,default"economics"),publisher(string),topic(string),format(string). Full actor spec: fetch build via GEThttps://api.apify.com/v2/acts/parseforge~data-gov-uk-scraper(Bearer TOKEN). Get token: https://console.apify.com/account/integrations

The Data.gov.uk Scraper collects open data catalog metadata from the UK government's data portal, returning 20+ fields per dataset: title, description, publisher, topic, format, download URL, update frequency, and license. Runs support up to 1,000,000 datasets on a paid plan.

Data.gov.uk hosts over 50,000 open datasets from UK government departments and public bodies. The Actor supports keyword search with publisher and topic filters.

🎯 Target AudienceπŸ’‘ Primary Use Cases
Data scientists, policy researchers, journalists, civic tech teams, academic researchers, open data advocatesOpen data discovery, policy research, data journalism, civic technology, government transparency analysis

πŸ“‹ What the Data.gov.uk Scraper does

Three search filters:

  • πŸ” Keyword search. Free-text search across dataset titles and descriptions.
  • πŸ›οΈ Publisher filter. Filter by government department or public body.
  • πŸ“‚ Topic filter. Browse by subject area.
  • πŸ”— URL mode. Paste a direct Data.gov.uk search URL.

Each dataset record includes title, description, publisher, topic, data format, download URL, update frequency, license, and portal URL.

πŸ’‘ Why it matters: browsing Data.gov.uk for relevant datasets means scrolling through search results and clicking into each listing. This Actor exports structured catalog metadata at scale, ready for your open data inventories or research pipelines.


🎬 Full Demo

🚧 Coming soon: a 3-minute walkthrough showing how to go from sign-up to a downloaded dataset.


βš™οΈ Input

InputTypeDefaultBehavior
startUrlstring""Direct Data.gov.uk search URL.
maxItemsinteger10Max datasets. Free: limited. Paid: up to 1,000,000.
searchQuerystring""Keyword search.
publisherstring""Government department or public body.
topicstring""Subject area filter.

Example: health datasets from NHS.

{
"searchQuery":"health",
"publisher":"NHS Digital",
"maxItems":50
}

Example: all transport datasets.

{
"topic":"transport",
"maxItems":100
}

⚠️ Good to Know: Data.gov.uk is the UK government's official open data portal. Datasets link to various formats (CSV, JSON, XML, PDF) hosted by individual departments.


πŸ“Š Output

Each dataset record contains 20+ fields. Download the catalog as CSV, Excel, JSON, or XML.

🧾 Schema

FieldTypeExample
πŸ“ titlestring"NHS Hospital Admissions"
πŸ“„ descriptionstring"Monthly hospital admission statistics..."
πŸ›οΈ publisherstring"NHS Digital"
πŸ“‚ topicstring"Health"
πŸ“¦ formatstring"CSV"
πŸ”— downloadUrlstring"https://data.gov.uk/dataset/..."
πŸ“… lastUpdatedstring"2026-03-15"
πŸ”„ updateFrequencystring"Monthly"
πŸ“œ licensestring"Open Government Licence"
πŸ”— portalUrlstring"https://www.data.gov.uk/dataset/..."
πŸ•’ scrapedAtISO 8601"2026-04-16T00:00:00.000Z"

πŸ“¦ Sample records


✨ Why choose this Actor

Capability
πŸ‡¬πŸ‡§Full Data.gov.uk catalog. 50,000+ UK government datasets.
πŸ”3 search filters. Keyword, publisher, topic.
πŸ“¦Format and download links. Direct URLs to CSV, JSON, XML files.
πŸ›οΈPublisher data. Government department per dataset.
πŸ“…Update frequency. Monthly, quarterly, annual cadence per dataset.
⚑Scalable. Quick lookups to full catalog sweeps.
🚫No authentication. Public open data portal.

πŸ“Š Data.gov.uk is the UK's official open data portal, hosting datasets from 900+ government organizations. Structured access powers every open data project, policy research, and civic technology workflow.


πŸ“ˆ How it compares to alternatives

ApproachCostCoverageRefreshFiltersSetup
⭐ Data.gov.uk Scraper (this Actor)$5 free credit, then pay-per-useFull catalogLive per runkeyword, publisher, topic⚑ 2 min
Manual Data.gov.uk browsingFreeOne at a timeManualUI onlyπŸ•’ Hours
CKAN API (direct)FreeFullReal-timeMany⏳ Hours (API setup)

Pick this Actor when you want UK open data catalog metadata on demand, with publisher and topic filters, without CKAN API integration.


πŸš€ How to use

  1. πŸ“ Sign up. Create a free account with $5 credit (takes 2 minutes).
  2. 🌐 Open the Actor. Go to the Data.gov.uk Scraper page on the Apify Store.
  3. 🎯 Set input. Enter a keyword, pick a publisher or topic.
  4. πŸš€ Run it. Click Start.
  5. πŸ“₯ Download. Grab results in the Dataset tab.

⏱️ Total time: 3-5 minutes. No coding required.


πŸ’Ό Business use cases

πŸ“Š Data Science & Research

  • Discover relevant UK government datasets
  • Build open data catalogs for research
  • Track new dataset publications
  • Analyze data coverage by topic

πŸ›οΈ Policy & Civic Tech

  • Monitor government data releases
  • Build transparency dashboards
  • Track department data publishing rates
  • Power civic apps with open data

πŸ“° Data Journalism

  • Find datasets for investigative stories
  • Track data freshness across departments
  • Build story pipelines from government data
  • Monitor new dataset publications

🏒 Business Intelligence

  • Enrich models with UK government data
  • Track economic indicators by topic
  • Build UK market data pipelines
  • Monitor regulatory data releases


🌟 Beyond business use cases

Data like this powers more than commercial workflows. The same structured records support research, education, civic projects, and personal initiatives.

πŸŽ“ Research and academia

  • Empirical datasets for papers, thesis work, and coursework
  • Longitudinal studies tracking changes across snapshots
  • Reproducible research with cited, versioned data pulls
  • Classroom exercises on data analysis and ethical scraping

🎨 Personal and creative

  • Side projects, portfolio demos, and indie app launches
  • Data visualizations, dashboards, and infographics
  • Content research for bloggers, YouTubers, and podcasters
  • Hobbyist collections and personal trackers

🀝 Non-profit and civic

  • Transparency reporting and accountability projects
  • Advocacy campaigns backed by public-interest data
  • Community-run databases for local issues
  • Investigative journalism on public records

πŸ§ͺ Experimentation

  • Prototype AI and machine-learning pipelines with real data
  • Validate product-market hypotheses before engineering spend
  • Train small domain-specific models on niche corpora
  • Test dashboard concepts with live input

πŸ€– Ask an AI assistant about this scraper

Open a ready-to-send prompt about this ParseForge actor in the AI of your choice:

❓ Frequently Asked Questions

πŸ”Œ Automating Data.gov.uk Scraper

  • 🟒 Node.js. Install the apify-client NPM package.
  • 🐍 Python. Use the apify-client PyPI package.
  • πŸ“š See the Apify API documentation for full details.

The Apify Schedules feature lets you trigger this Actor on any cron interval. Weekly pulls catch new dataset publications.

πŸ”Œ Integrate with any app


πŸ”— Recommended Actors

πŸ’‘ Pro Tip: browse the complete ParseForge collection for more government and open data scrapers.


πŸ†˜ Need Help? Open our contact form to request a new scraper, propose a custom data project, or report an issue.


⚠️ Disclaimer: this Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by the UK government or Data.gov.uk. All trademarks mentioned are the property of their respective owners. Only publicly available open data catalog metadata is collected.

You might also like

GOV UK Companies Register

harvestedge/gov-uk-companies-register

The UK Companies Scraper for UK Chamber of Commerce. Ideal for lead generation, compliance checks, KYC enrichment, and UK company intelligence workflows. GOV.UK

Data.gov.uk Scraper - Low-costπŸ’²πŸ”₯πŸ“šπŸ‡¬πŸ‡§

delectable_incubator/data-gov-uk-scraper-low-cost

Scrape data.gov.uk dataset listings πŸ”ŽπŸ“Š with a powerful open data scraper. Extract dataset titles, publishers, update dates, descriptions, tags, and dataset URLs from search results. Ideal for government data monitoring, open data research, dataset discovery, and structured data catalog creation πŸš€

UK Government Data API

lentic_clockss/uk-data-search

Search UK charity, planning, health, tribunal, procurement, and business data in one run. Get structured UK records fast.

Data.gov.uk Scraper - Cheap πŸŒπŸ“ŠπŸ‡¬πŸ‡§

scrapestorm/data-gov-uk-scraper---cheap

πŸ”Ž Easily collect dataset listings from data.gov.uk Provide one or multiple search URLs and extract dataset information such as πŸ“„ Dataset Title 🏒 Published By πŸ•’ Last Updated πŸ“ Description πŸ”— Dataset URL & more Perfect for open data research, government data monitoring & dataset discovery πŸ“ŠπŸš€

1

5.0

GOV.UK Content Search Scraper

parseforge/govuk-content-search-scraper

Scrape GOV.UK: search the entire UK government publications catalogue (policies, guidance, news, statistics). Filter by query, organisation, format or date. Returns titles, descriptions, URLs, organisations and publication dates.

UK Companies House

artificially/uk-companies-house

Search and extract company data from UK Companies House. Get company details, officers, filing history, and more from the official UK government registry.

Company House GOV.UK

nocodeventure/company-house-gov-uk

Get all the information you need about UK companies in seconds! This scraper grabs data from the official Companies House website - that's where the UK government keeps records of every company.

πŸ‘ User avatar

No-Code Venture

18

Company House GOV.UK (PPE)

nocodeventure/company-house-gov-uk-ppe

Get all the information you need about UK companies in seconds! This scraper grabs data from the official Companies House website - that's where the UK government keeps records of every company.

πŸ‘ User avatar

No-Code Venture

8

Data.gov API - US Open Government Datasets

alizarin_refrigerator-owner/data-gov-api---us-open-government-datasets

Access the Data.gov catalog of 300,000+ US government datasets. Search datasets by topic, agency, format, and keywords. Discover open data from federal, state, and local governments