VOOZH about

URL: https://apify.com/crawlerbros/terraform-registry-scraper

โ‡ฑ Terraform Registry Scraper ยท Apify


Pricing

from $3.00 / 1,000 results

Go to Apify Store

Terraform Registry Scraper

Scrape the Terraform Registry - search modules and providers, or fetch details for specific modules/providers. Returns downloads, versions, descriptions, source URLs, and verification status.

Pricing

from $3.00 / 1,000 results

Rating

0.0

(0)

Developer

๐Ÿ‘ Crawler Bros

Crawler Bros

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

24 days ago

Last modified

Share

Search and extract data from the Terraform Registry โ€” HashiCorp's official repository for Terraform modules and providers. Retrieve module details, provider information, download counts, version histories, and verification status without any authentication.

What Does This Actor Do?

This actor scrapes the public Terraform Registry API (registry.terraform.io) to help you:

  • Discover Terraform modules by searching across thousands of community and verified modules
  • Find Terraform providers covering AWS, Azure, Google Cloud, Kubernetes, and hundreds more
  • Get detailed metadata for specific modules or providers by namespace/name
  • Monitor download trends and identify the most popular infrastructure components
  • Track module versions and see the full version history of any module or provider

Output Data

Each record contains fields such as:

FieldDescription
idFull registry ID (e.g. terraform-aws-modules/vpc/aws/6.6.1)
namespacePublisher namespace (e.g. terraform-aws-modules)
nameModule or provider name
providerCloud provider (modules only, e.g. aws, azurerm, google)
versionLatest published version
descriptionShort description of the module/provider
ownerOwner/author username
sourceSource code repository URL
sourceUrlCanonical Terraform Registry URL
published_atISO 8601 publication timestamp
downloadsTotal download count
verifiedWhether the module is HashiCorp-verified
versionsList of all published versions
tierProvider tier: official, partner, or community
logo_urlProvider logo image URL
recordTypeRecord type: module or provider
scrapedAtISO 8601 timestamp of when the record was scraped

Input Configuration

Mode

Select the scraping mode:

ModeDescription
searchModulesFull-text search across all Terraform modules
searchProvidersBrowse and search all Terraform providers
getModuleFetch a specific module by namespace/name/provider
getProviderFetch a specific provider by namespace/type

Input Fields

FieldTypeDescription
modestring (required)Scraping mode (see above)
querystringFree-text search query (searchModules / searchProviders)
providerstringFilter modules by provider, e.g. aws, azurerm, google (searchModules)
namespacestringPublisher namespace for direct lookup (getModule / getProvider)
namestringModule name for direct lookup (getModule)
providerTypestringProvider type for direct lookup (getProvider)
verifiedbooleanOnly return verified modules (default: false)
maxItemsintegerMaximum records to return (1โ€“10000, default: 100)

Example Inputs

Search VPC modules for AWS

{
"mode":"searchModules",
"query":"vpc",
"provider":"aws",
"maxItems":50
}

Search all AWS providers

{
"mode":"searchProviders",
"query":"aws",
"maxItems":20
}

Get a specific module

{
"mode":"getModule",
"namespace":"terraform-aws-modules",
"name":"vpc",
"provider":"aws"
}

Get the HashiCorp AWS provider

{
"mode":"getProvider",
"namespace":"hashicorp",
"providerType":"aws"
}

Only verified modules

{
"mode":"searchModules",
"query":"kubernetes",
"verified":true,
"maxItems":100
}

Use Cases

  • Infrastructure discovery โ€” Find reusable Terraform modules for your cloud infrastructure
  • DevOps tooling โ€” Build internal catalogs of approved/verified Terraform modules
  • Market research โ€” Analyze download trends and popular providers in the IaC ecosystem
  • Security auditing โ€” Track module versions and identify outdated infrastructure components
  • CI/CD automation โ€” Monitor new module releases and automate dependency updates
  • Developer portals โ€” Populate internal developer portals with curated Terraform resources

FAQ

Do I need authentication? No. The Terraform Registry public API requires no API keys or credentials.

How many records can I get? Up to 10,000 records per run. The registry contains thousands of modules and hundreds of providers.

What providers are available? The registry includes providers for all major clouds (AWS, Azure, Google Cloud, Oracle, IBM), databases (PostgreSQL, MySQL, MongoDB), networking (Cloudflare, Datadog), and hundreds of SaaS platforms.

Are versions included? Yes, the versions field contains the full list of published versions for each module or provider.

Can I filter by provider in searchModules? Yes, use the provider field to filter by provider slug (e.g. aws, azurerm, google, kubernetes).

What is a verified module? HashiCorp-verified modules are maintained by trusted partners and follow HashiCorp's module standards. Set verified: true to only return these.

You might also like

Terraform Registry Scraper

crawlergang/terraform-registry-scraper

Scrape the Terraform Registry - search modules and providers, or fetch details for specific modules/providers. Returns downloads, versions, descriptions, source URLs, and verification status.

2

5.0

Terraform Registry Modules Scraper

parseforge/terraform-registry-modules-scraper

Browse the HashiCorp Terraform Registry for module metadata across every provider. Pull namespace, name, version, owner, source repo URL, usage counts, and verified status. Filter by keyword, provider, or namespace. Handy for module catalogs, version tracking, and provenance audits.

Drupal.org Modules Scraper

crawlerbros/drupal-org-modules-scraper

Scrape Drupal.org modules with search by keyword, browse by category, fetch trending by install count, or look up specific module IDs. Returns title, machine name, install count, compatible Drupal versions, author, categories, and more.

LuaRocks Scraper

crawlergang/luarocks-scraper

Scrape LuaRocks - the official Lua package repository. Search modules or fetch details for specific rocks. Extract names, descriptions, authors, versions, licenses, homepages, download counts, and labels.

2

5.0

LuaRocks Scraper

crawlerbros/luarocks-scraper

Scrape LuaRocks - the official Lua package repository. Search modules or fetch details for specific rocks. Extract names, descriptions, authors, versions, licenses, homepages, download counts, and labels.

Go pkg.go.dev Modules Scraper

parseforge/go-pkg-modules-scraper

Monitor structured records from Go Pkg Modules with names, identifiers, dates, descriptions, status flags and source links. Trusted by research, intelligence and operational dashboards. Run on demand or on a recurring schedule and feed every row into your favourite analytics or workflow stack.

NPI Registry Scraper | 7M+ US Healthcare Providers (CMS)

haketa/nppes-npi-registry-scraper

NPPES NPI Registry scraper & API: search 8M+ US healthcare providers and export NPI, name, taxonomy and specialty, practice and mailing address, phone, credentials and enumeration date. Healthcare provider data, verification and lead generation โ€” fast, no login.