Similarweb Scraper

Pricing

Rating

Developer

Actor stats

Categories

Share

A simple scraper for similarweb.com. Retrieve website popularity information and get it in a JSON/XML/CSV/Excel/HTML table format. You can get the following data from every scrape:

• Website information
• Company information
• Total visits, pages per visit, avg. visit duration, bounce rate
• Popularity ranking (global/country/category)
• Traffic sources (ads/referrals/direct/search/social/etc..)
• Social network distribution
• Competitors
• Used technologies
• Age/gender distribution
• Popular topics/websites among users
• Top countries

Use Cases

You can use this scraper in order to get information about the popularity of certain websites, which you can then use for market research, to track potential competitors, or for other research.

Input

The actor only needs to know which websites to get information from, and which proxies to use. You can specify multiple websites to get multiple results on one run.

Cost of usage

You need to use proxies when scraping from the Apify platform. Any type of proxy (datacenter/residental/custom) should be OK. You can use either Apify Proxy or provide your own custom proxies.

In terms of platform usage credits, scraping 20 websites takes about 0.02 compute units (depending on proxy and number of retries).

Results

The actor stores its result in the default dataset associated with the actor run. It can be then exported to various formats, such as JSON, XML, CSV or Excel.

Please note that some results might not be available due to being locked behind a paywall.

Each website in the dataset will contain a seperate object that follows this format (JSON is used below):

{
"url":"https://similarweb.com/website/apify.com/",
"name":"apify.com",
"description":"apify is your one-stop shop for web scraping, data extraction, and rpa. automate anything you can do manually in a browser.",
"icon":"https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6",
"previewDesktop":"https://site-images.similarcdn.com/image?url=apify.com&t=1&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6",
"previewMobile":"https://site-images.similarcdn.com/image?url=apify.com&t=4&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6",
"totalVisits":285658,
"bounceRate":"35.72%",
"pagesPerVisit":11.086998131906656,
"avgVisitDuration":"00:05:25",
"companyName":"Apify",
"companyYearFounded":2015,
"companyEmployeesMin":11,
"companyEmployeesMax":50,
"companyAnnualRevenueMin":1000000,
"companyHeadquarterCountryCode":"CZ",
"companyHeadquarterCity":"Prague 1",
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"globalRank":98867,
"countryRank":72656,
"categoryRank":1783,
"organicTraffic":0.9446483472979003,
"paidTraffic":0.05535165270209973,
"socialNetworkDistribution":[
{
"name":"Youtube",
"visitsShare":0.555749769714253,
"icon":"https://site-images.similarcdn.com/image?url=youtube.com&t=2&s=1&h=e117fb09ba0a34dee9830863bf927d29fc864e342583a36a667bf12346e88e20"
},
{
"name":"Reddit",
"visitsShare":0.1294792867787483,
"icon":"https://site-images.similarcdn.com/image?url=reddit.com&t=2&s=1&h=66f2412047e0362ec60d5583d4b186511a8e859446bb112c60d22968facae906"
},
{
"name":"Facebook",
"visitsShare":0.10344909798525086,
"icon":"https://site-images.similarcdn.com/image?url=facebook.com&t=2&s=1&h=be773d6b77aa3d59b6a671c5c27ad729b1ae77400e89776e2f749cce6b926c4b"
},
{
"name":"Linkedin",
"visitsShare":0.081436906611932,
"icon":"https://site-images.similarcdn.com/image?url=linkedin.com&t=2&s=1&h=64a0e043fc8ff74ac308e3f0e136ae7d1b6544be4e9e704ad7fd062070be48a1"
},
{
"name":"Twitter",
"visitsShare":0.04238240993289261,
"icon":"https://site-images.similarcdn.com/image?url=twitter.com&t=2&s=1&h=05438debe431144d9c727828570d1754a25bd9286bc14f3aa65a4f05b9057e25"
}
],
"topReferrals":[
{
"domain":"",
"icon":"",
"visitsShare":0.3174298845325629,
"isLocked":true
},
{
"domain":"",
"icon":"",
"visitsShare":0.15288238420340347,
"isLocked":true
},
{
"domain":"octoparse.com",
"icon":"https://site-images.similarcdn.com/image?url=octoparse.com&t=2&s=1&h=c3b0fe1c71cd16076498c2f0587c1c5bb42a35df3bc455d331dc98749471d8e0",
"visitsShare":0.031664665386702325,
"isLocked":false
},
{
"domain":"link.juejin.cn",
"icon":"https://site-images.similarcdn.com/image?url=link.juejin.cn&t=2&s=1&h=bfacf073ed7b1c800c3035a0fef21612cac754b096f6c600274fc49418123a18",
"visitsShare":0.02823073459240298,
"isLocked":false
},
{
"domain":"inoreader.com",
"icon":"https://site-images.similarcdn.com/image?url=inoreader.com&t=2&s=1&h=c05ae0827de93d5c5b123d0e28baed08b0035439a2ef006644cdde8fee871cf2",
"visitsShare":0.02823073459240298,
"isLocked":false
}
],
"trafficSources":{
"directVisitsShare":0.38422379603583773,
"referralVisitsShare":0.041544361957825814,
"searchVisitsShare":0.5121789687451688,
"socialNetworksVisitsShare":0.04267751195086787,
"mailVisitsShare":0.018558673566329117,
"adsVisitsShare":0.0008166877439706386
},
"adsSource":[],
"topKeywords":[
{
"name":"apify",
"visitsShare":0.08389224328443522
},
{
"name":"soccerstats",
"visitsShare":0.009348653363724252
},
{
"name":"google serps scraper",
"visitsShare":0.008865553034919123
},
{
"name":"uploaded downloader",
"visitsShare":0.007676958193845651
},
{
"name":"twitter scraper",
"visitsShare":0.007181326512134639
}
],
"topSimilarityCompetitors":[
{
"domain":"scraperapi.com",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=scraperapi.com&t=2&s=1&h=4c0af08959b60e108f82c9a27f8084eb29ae1d09006d23839e9b6b68db11255e",
"visitsTotalCount":126101.48616665995,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":12336,
"affinity":1
},
{
"domain":"bestproxyreviews.com",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=bestproxyreviews.com&t=2&s=1&h=19ab06a3d3326e7ce5269d6da266f5920b3165763f9862c4ecab8c2ced111ad6",
"visitsTotalCount":253032.74555136525,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":8899,
"affinity":0.9644609573591866
},
{
"domain":"botster.io",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=botster.io&t=2&s=1&h=dad2d8775d7101d1207c4bec26ec1633730d65d932caac4434975fcdf9b84424",
"visitsTotalCount":37403.129781035175,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":18549,
"affinity":0.9553920428910792
},
{
"domain":"stevesie.com",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=stevesie.com&t=2&s=1&h=da4c037450544a7afdb058e2afea74e7c2ef21589ab2414fdbc00fd60e258035",
"visitsTotalCount":56006.41102190646,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":22166,
"affinity":0.9521190384551853
},
{
"domain":"proxycrawl.com",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=proxycrawl.com&t=2&s=1&h=0ff2659c9d9ff2d0bb02f2d7dd3850558f876ee5d89f770cdd4bf55ddd84c7e1",
"visitsTotalCount":30148.839317697628,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":28892,
"affinity":0.9418962330274461
},
{
"domain":"oxylabs.io",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=oxylabs.io&t=2&s=1&h=35e259e4de4df73136cacf118058b13978003bb6c5bb802c708ca506f2708aff",
"visitsTotalCount":237244.66895191185,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":7711,
"affinity":0.9202838053800582
},
{
"domain":"dataminer.io",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=dataminer.io&t=2&s=1&h=630a2ec15709d7f82775457992757d4d4af0283fcfe9e71694f4faa52c1971d9",
"visitsTotalCount":94122.64371803365,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":14729,
"affinity":0.9132025980663713
},
{
"domain":"anti-captcha.com",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=anti-captcha.com&t=2&s=1&h=98a3065a90944886c3f21d756db9faad7f359e698ecfd244b8ef40d4ec719441",
"visitsTotalCount":153401.45283910492,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":8349,
"affinity":0.9100651910734987
},
{
"domain":"antcpt.com",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=antcpt.com&t=2&s=1&h=01f1afe338901d815481a1d4387fb1ab2d597830d0d2d50f1d575939ab4e93e5",
"visitsTotalCount":31698.755382545365,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":28543,
"affinity":0.8884533949838682
},
{
"domain":"serpapi.com",
"isSmallSite":false,
"icon":"https://site-images.similarcdn.com/image?url=serpapi.com&t=2&s=1&h=02d8d33feda4b216b1e5714b47becb8e23fe7e86e010668b1a2fabe29d6c5b19",
"visitsTotalCount":93494.18092562244,
"categoryId":"computers_electronics_and_technology/computers_electronics_and_technology",
"categoryRank":13176,
"affinity":0.8775319254115675
}
],
"technologies":[
{
"categoryId":"conversion_and_analytics",
"topTechName":"Google Analytics",
"topTechIconUrl":"https://www.similartech.com/images/technology?id=1",
"technologiesTotalCount":3
},
{
"categoryId":"payment_and_currencies",
"topTechName":"United States Dollar",
"topTechIconUrl":"https://www.similartech.com/images/technology?id=3579",
"technologiesTotalCount":3
},
{
"categoryId":"mobile",
"topTechName":"Meta Viewport",
"topTechIconUrl":"https://www.similartech.com/images/technology?id=1325",
"technologiesTotalCount":2
},
{
"categoryId":"social",
"topTechName":"Instagram",
"topTechIconUrl":"https://www.similartech.com/images/technology?id=2841",
"technologiesTotalCount":2
}
],
"countryRankCompetitors":[
{
"rank":72654,
"domain":"careers.davita.com",
"icon":"https://site-images.similarcdn.com/image?url=careers.davita.com&t=2&s=1&h=9f441bb1de86c23471105962fdc36dabe319171f5c0392d46e29461d73d94844"
},
{
"rank":72655,
"domain":"talesofxadia.com",
"icon":"https://site-images.similarcdn.com/image?url=talesofxadia.com&t=2&s=1&h=aa850070f135a4805c264d8bfbdead62eba2507f05b069026e76791cb9e83fd4"
},
{
"rank":72656,
"domain":"apify.com",
"icon":"https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6"
},
{
"rank":72657,
"domain":"cota.com",
"icon":"https://site-images.similarcdn.com/image?url=cota.com&t=2&s=1&h=67a732991f265dc7f7821228b9f876a22ca9e3f981048e7715cba97efba8ff4e"
},
{
"rank":72658,
"domain":"disneyheroesgame.com",
"icon":"https://site-images.similarcdn.com/image?url=disneyheroesgame.com&t=2&s=1&h=13c7027cc2bd902a818704cdbb098ccd646ecdd98a0752e11f04c1deac9efdb0"
}
],
"globalRankCompetitors":[
{
"rank":98865,
"domain":"yellowlist.ga",
"icon":"https://site-images.similarcdn.com/image?url=yellowlist.ga&t=2&s=1&h=c0eca8386a0f8f8d89d80ba9151b10910f8d937246b6a09dcd7769c291114d2c"
},
{
"rank":98866,
"domain":"ctrlqq.com",
"icon":"https://site-images.similarcdn.com/image?url=ctrlqq.com&t=2&s=1&h=c3a4e3a18a786026de47deca72403551fe3e881798a08fdef89ca5c220b11e81"
},
{
"rank":98867,
"domain":"apify.com",
"icon":"https://site-images.similarcdn.com/image?url=apify.com&t=2&s=1&h=125d66be47a23677bb607b06989996d242ec48f6fa515f16fb9caf60be1ad6f6"
},
{
"rank":98868,
"domain":"acerta.be",
"icon":"https://site-images.similarcdn.com/image?url=acerta.be&t=2&s=1&h=5f9476b187311b0781f1e74e75a40db31a35ce7e72f12b4085c172a403fa55b4"
},
{
"rank":98869,
"domain":"hotstunners.com",
"icon":"https://site-images.similarcdn.com/image?url=hotstunners.com&t=2&s=1&h=948f81cb99cde75e02cb53014d13b1efa73656e877d82a12935c9b4ca4fb197a"
}
],
"ageDistribution":[
{
"minAge":25,
"maxAge":34,
"value":0.35234052809731825
},
{
"minAge":18,
"maxAge":24,
"value":0.21945284325035158
},
{
"minAge":35,
"maxAge":44,
"value":0.21090538306365286
},
{
"minAge":45,
"maxAge":54,
"value":0.11335258120916632
},
{
"minAge":55,
"maxAge":64,
"value":0.06529810997281398
},
{
"minAge":65,
"value":0.03865055440669721
}
],
"maleDistribution":0.66426264830038,
"femaleDistribution":0.33573735169962005,
"topInterestedWebsites":[
{
"domain":"youtube.com",
"icon":"https://site-images.similarcdn.com/image?url=youtube.com&t=2&s=1&h=e117fb09ba0a34dee9830863bf927d29fc864e342583a36a667bf12346e88e20"
},
{
"domain":"github.com",
"icon":"https://site-images.similarcdn.com/image?url=github.com&t=2&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b"
},
{
"domain":"stackoverflow.com",
"icon":"https://site-images.similarcdn.com/image?url=stackoverflow.com&t=2&s=1&h=04179ebf8566da481b023bba12856a0748752b1e4a75d1b145220282ef93f21c"
},
{
"domain":"google.com",
"icon":"https://site-images.similarcdn.com/image?url=google.com&t=2&s=1&h=eb35e0fbafa3eb290132ffdfe47187d950d68daaa659ec1bd4b4e834b8f16461"
},
{
"domain":"facebook.com",
"icon":"https://site-images.similarcdn.com/image?url=facebook.com&t=2&s=1&h=be773d6b77aa3d59b6a671c5c27ad729b1ae77400e89776e2f749cce6b926c4b"
}
],
"topInterestedTopics":["google","community","social network","google apps","internet tools"],
"topInterestedCategories":[
"computers_electronics_and_technology/programming_and_developer_software",
"computers_electronics_and_technology/social_networks_and_online_communities",
"computers_electronics_and_technology/computers_electronics_and_technology",
"computers_electronics_and_technology/search_engines",
"arts_and_entertainment/tv_movies_and_streaming"
],
"topCountries":[
{
"countryAlpha2Code":"US",
"countryUrlCode":"united-states",
"visitsShare":0.21264547639057968,
"visitsShareChange":0.19016252206567225
},
{
"countryAlpha2Code":"GB",
"countryUrlCode":"united-kingdom",
"visitsShare":0.06394865516808063,
"visitsShareChange":0.4215578032405554
},
{
"countryAlpha2Code":"CZ",
"countryUrlCode":"czech-republic",
"visitsShare":0.06388982438929405,
"visitsShareChange":-0.024172427963833513
},
{
"countryAlpha2Code":"CN",
"countryUrlCode":"",
"visitsShare":0.05072343290553418,
"visitsShareChange":1.1005513909248006
},
{
"countryAlpha2Code":"VN",
"countryUrlCode":"vietnam",
"visitsShare":0.04795609462352368,
"visitsShareChange":-0.5317095440011445
}
]
}