Similarweb Scraper

Pricing

Rating

Developer

Actor stats

Categories

Share

Extract website traffic analytics, rankings, traffic sources, top keywords, and AI traffic insights from SimilarWeb. Analyze any domain in bulk — no API key, login, or SimilarWeb account required.

What can this scraper do?

• Traffic analytics — Get total monthly visits, bounce rate, pages per visit, and average time on site
• Global and category rankings — See where a website ranks globally, in its country, and within its category
• Traffic source breakdown — Understand how much traffic comes from direct, search, social, referrals, email, and paid sources
• Top keywords — Discover the top search keywords driving traffic, with search volume and CPC data
• AI traffic insights — See which AI chatbots (ChatGPT, Perplexity, etc.) are sending traffic to a website
• Top AI prompts — Find out what prompts users ask AI chatbots that mention this website
• Historical data — Get 3 months of estimated monthly visit history
• Bulk analysis — Analyze hundreds of domains in a single run
• Geographic distribution — See the top 5 countries by traffic share

Input

Example Input

Single domain

{
"domains":["google.com"]
}

Multiple domains for competitive analysis

{
"domains":[
"google.com",
"bing.com",
"duckduckgo.com",
"yahoo.com"
]
}

Various URL formats (all normalized automatically)

{
"domains":[
"https://www.reddit.com/r/popular",
"facebook.com",
"www.twitter.com",
"http://apify.com"
]
}

Output

Each domain produces one row in the dataset with the following fields:

Sample Output

{
"domain":"google.com",
"title":"Google",
"description":"Learn about the Certified Publisher Program...",
"category":"computers_electronics_and_technology/search_engines",
"globalRank":1,
"countryRank":1,
"countryRankCountry":"US",
"categoryRank":1,
"categoryName":"Computers_Electronics_and_Technology/Search_Engines",
"totalVisits":85756574615,
"bounceRate":0.283585,
"pagesPerVisit":8.52,
"timeOnSite":610.41,
"engagementMonth":"2026-01",
"trafficSourceDirect":0.858270,
"trafficSourceSearch":0.083459,
"trafficSourceSocial":0.007599,
"trafficSourceReferrals":0.044567,
"trafficSourceMail":0.002837,
"trafficSourcePaidReferrals":0.003267,
"topCountries":"[{\"countryCode\": \"US\", \"share\": 0.2459}, ...]",
"topKeywords":"[{\"name\": \"gemini\", \"volume\": 100378910, \"cpc\": 0.42, \"estimatedValue\": 151798290}]",
"aiTrafficSplit":"[{\"name\": \"chatgpt.com\", \"rank\": 1}]",
"aiChatbotDistribution":"[{\"name\": \"chatgpt.com\", \"value\": 59.83}]",
"aiTotalVisits":500000000,
"topPrompts":"[\"What is the most popular search engine?\"]",
"isSmall":false,
"screenshot":"https://site-images.similarcdn.com/image?url=...",
"snapshotDate":"2026-01-01T00:00:00+00:00",
"scrapeTimestamp":"2026-03-11T12:00:00.000000+00:00"
}

FAQ

Do I need a SimilarWeb account or API key?

No. This scraper works without any authentication, API key, or SimilarWeb account. It uses publicly available SimilarWeb data.

How accurate is the data?

The data comes directly from SimilarWeb's analytics platform, the same source used by marketing professionals and analysts worldwide. Traffic estimates are based on SimilarWeb's panel-based methodology.

What does the isSmall flag mean?

When isSmall is true, SimilarWeb does not have enough data for the domain. This typically happens with very small websites that don't have enough traffic to generate reliable estimates. The output row will still be created but metrics may be zero.

How often is the data updated?

SimilarWeb updates their data monthly. The snapshotDate field shows the date of the most recent data snapshot. The engagementMonth field shows which month the engagement metrics correspond to.

Can I analyze any domain?

Yes, you can analyze any website domain. Large, well-known websites will have the most comprehensive data. Smaller sites may return limited data (indicated by isSmall: true).

What is AI traffic data?

SimilarWeb now tracks traffic that comes from AI chatbots like ChatGPT, Perplexity, and others. The aiTrafficSplit shows which AI platforms send traffic to the analyzed domain, and aiChatbotDistribution shows the percentage breakdown. The topPrompts field reveals what users ask AI chatbots that results in mentions of this website.

What formats can I use for domain input?

The scraper accepts domains in many formats and normalizes them automatically:

• google.com (bare domain)
• https://google.com (with protocol)
• www.google.com (with www prefix)
• https://www.google.com/search?q=test (with path and query — stripped automatically)

How many domains can I analyze in one run?

You can analyze up to 5,000 domains in a single run. The scraper processes them sequentially with a small delay between requests to ensure reliability.

What are the traffic source percentages?

Traffic source values are decimals between 0 and 1 (not percentages). For example, trafficSourceDirect: 0.858270 means 85.83% of traffic comes from direct visits. The six traffic sources (Direct, Search, Social, Referrals, Mail, Paid Referrals) sum to approximately 1.0.