VOOZH about

URL: https://apify.com/crawlergang/go-packages-scraper

⇱ Go Packages Scraper (pkg.go.dev) Β· Apify

πŸ‘ Go Packages Scraper (pkg.go.dev) avatar

Go Packages Scraper (pkg.go.dev)

Pricing

from $3.00 / 1,000 results

Go to Apify Store

Go Packages Scraper (pkg.go.dev)

Scrapes Go package metadata from pkg.go.dev and Go module proxy. Search packages by query or fetch specific modules by path.

Pricing

from $3.00 / 1,000 results

Rating

5.0

(11)

Developer

πŸ‘ Crawler Gang

Crawler Gang

Maintained by Community

Actor stats

11

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Share

Scrape Go package metadata from pkg.go.dev and the Go module proxy. Search packages by keyword or fetch specific modules by their import path.

Features

  • Search Packages β€” find Go packages matching any keyword (e.g., "web framework", "database ORM", "CLI")
  • Get By Module β€” fetch detailed metadata for specific modules by their Go import path
  • Extracts version, license, synopsis, Go version requirement, direct imports, and importedBy count
  • Sources data from pkg.go.dev search results and the official Go module proxy (proxy.golang.org)
  • No authentication or API keys required

Input

FieldTypeDescriptionDefault
modeselectsearchPackages or getByModulesearchPackages
searchQuerystringKeyword to search (e.g. "gin web framework")β€”
modulePathsarrayModule import paths for getByModule (e.g. ["github.com/gin-gonic/gin"])[]
maxItemsintegerMax records to return (1–500)50

Example: Search Packages

{
"mode":"searchPackages",
"searchQuery":"gin web framework",
"maxItems":20
}

Example: Get By Module

{
"mode":"getByModule",
"modulePaths":[
"github.com/gin-gonic/gin",
"github.com/gorilla/mux",
"gorm.io/gorm"
],
"maxItems":10
}

Output

Each record contains:

FieldDescription
modulePathFull Go module path (e.g. github.com/gin-gonic/gin)
packageNameLast segment of module path (e.g. gin)
versionLatest published version (e.g. v1.9.1)
synopsisShort description of the package
licenseLicense identifier (e.g. MIT, Apache-2.0)
publishedAtISO timestamp of latest version release
goVersionMinimum Go version required (e.g. go1.20)
importsList of direct module dependencies
importedByNumber of other packages that import this one
repositoryUrlGitHub/GitLab repository URL
sourceUrlLink to package page on pkg.go.dev
recordTypeAlways "package"
scrapedAtISO timestamp when record was scraped

Sample Output

{
"modulePath":"github.com/gin-gonic/gin",
"packageName":"gin",
"version":"v1.12.0",
"synopsis":"Gin is a HTTP web framework written in Go",
"license":"MIT",
"publishedAt":"Feb 28, 2026",
"goVersion":"go1.20",
"imports":["github.com/gin-contrib/sse","github.com/go-playground/validator/v10"],
"importedBy":183243,
"repositoryUrl":"https://github.com/gin-gonic/gin",
"sourceUrl":"https://pkg.go.dev/github.com/gin-gonic/gin",
"recordType":"package",
"scrapedAt":"2026-01-01T12:00:00+00:00"
}

Use Cases

  • Dependency research β€” explore popular packages before adopting them
  • Security audits β€” check what packages are widely used and their licenses
  • Competitive analysis β€” compare package adoption and import counts
  • Tech stack monitoring β€” track version updates across your Go dependencies
  • Developer tools β€” build package registries or recommendation systems

FAQ

Does this require a Go installation? No. The actor fetches data directly from pkg.go.dev and the Go module proxy over HTTP.

Why are some fields missing on some records? Fields like synopsis, license, and goVersion are optional and only included when present in the source data.

What is importedBy? The number of public Go packages that directly import this module, as reported by pkg.go.dev.

Can I search for private modules? No. This scraper only accesses publicly available packages on pkg.go.dev.

What is the rate limit? pkg.go.dev and the Go module proxy are public services. The actor respects reasonable delays between requests to avoid overloading them.

How current is the data? The actor fetches live data from pkg.go.dev and the Go module proxy at scrape time.

You might also like

Go Packages Scraper (pkg.go.dev)

crawlerbros/go-packages-scraper

Scrapes Go package metadata from pkg.go.dev and Go module proxy. Search packages by query or fetch specific modules by path.

Go pkg.go.dev Modules Scraper

parseforge/go-pkg-modules-scraper

Monitor structured records from Go Pkg Modules with names, identifiers, dates, descriptions, status flags and source links. Trusted by research, intelligence and operational dashboards. Run on demand or on a recurring schedule and feed every row into your favourite analytics or workflow stack.

Actor in Go example

jirimoravcik/go-actor-example

Example actor written in Go.

πŸ‘ User avatar

JiΕ™Γ­ Moravčík

16

Pub.dev Scraper

crawlergang/pub-dev-scraper

Scrape Pub.dev, the official Dart and Flutter package repository with 40K+ packages. Search packages, fetch package details with scores, get all packages by a publisher, or browse trending packages.

2

5.0

Pub.dev Scraper

crawlerbros/pub-dev-scraper

Scrape Pub.dev, the official Dart and Flutter package repository with 40K+ packages. Search packages, fetch package details with scores, get all packages by a publisher, or browse trending packages.

Go Vita AU Health Product Scraper

dromb/govita-au-product-search-catalog-unofficial

Scrape Go Vita Australia health product search results, categories, prices, offers, and normalized item data for product monitoring.

3

Product Launch Campaign (AI) - Go-to-Market Plan

macheta/product-launch-campaign

Generate a complete go-to-market launch plan with day-by-day assets: messaging, emails, posts, scripts, and image prompts across chosen channels.

CRAN R Package Scraper

crawlergang/cran-scraper

Scrapes R package metadata from the CRAN database (crandb.r-pkg.org). Search packages by query, fetch by name, or list recent releases.

2

5.0

CRAN R Package Scraper

crawlerbros/cran-scraper

Scrapes R package metadata from the CRAN database (crandb.r-pkg.org). Search packages by query, fetch by name, or list recent releases.

Pay-as-you-go API / JSON scraper

pocesar/pay-as-you-go-api-json-scraper

Scrape as pay-as-you-go any API / JSON URLs directly to the dataset, and return them in CSV, XML, HTML, or Excel formats. Transform and filter the output. Enables you to follow pagination recursively from the payload without the need to visit the HTML page.

106