Pricing
$5.00/month + usage
Shopify Scraper
Shopify online store collection and product data extractor. Supports realtime price/stock monitor. Crawl product list or single product in a structured form, including title,description,price,sku, etc.
Pricing
$5.00/month + usage
Rating
4.3
(5)
Developer
Actor stats
68
Bookmarked
2.1K
Total users
32
Monthly active users
14 days ago
Last modified
Categories
Share
**Shopify Scraper is a professional-grade crawling tool designed to extract high-fidelity product data from any e-commerce store built on the Shopify platform. This version uses the Pay-Per-Event pricing model, meaning you only pay for the products and collections you actually scrape.
Why Use Shopify Scraper?
- 📊 Market Research: Analyze competitor pricing, inventory, product variants, and descriptions to sharpen your strategy.
- 📈 Trend Monitoring: Track new product launches and stock status changes across multiple brands in real-time.
- 🗂️ Data Aggregation: Build comprehensive product catalogs by aggregating data from various Shopify-based stores.
- 🎯 Marketing Insights: Understand how successful brands structure their metadata, tags, and categories.
🔄 Just need a one-time dump of data? Check out our Shopify Scraper (PPE) actor.
Key Features
- 🔍 Search Support: Find products by keyword using the built-in search functionality.
- 🎁 Product Recommendations: Optionally fetch recommended products for each item (configurable limit).
- 🚀 Store-wide Extraction: Capable of crawling an entire store's catalog, from collections to individual products.
- 🎯 Precision Targeting: Fetch specific collections or singular product URLs with surgical precision.
- 💱 Currency Normalization: Automatically handles currency selection and formats prices (multiplied by 100) to ensure financial accuracy without floating-point errors.
- 📦 Comprehensive Data: Extracts everything: titles, descriptions, images, options (size/color), variants, and real-time stock status.
- 🛡️ Resilience: Includes logic to bypass common gateway restrictions and handle "InStock"/"OutOfStock" parsing robustly.
Important Note
On certain Shopify websites, multiple SKUs may be visually merged into a single product page. Please be aware that this scraper treats each SKU as an individual product entry and does not perform any merging of these SKUs.
How it Works
1. Verification
Before running the scraper, verify your target is a Shopify store:
- Navigate to
https://<domain>/admin(e.g.,https://gymshark.com/admin). - If you see a Shopify login page, the site is compatible.
2. Configuration
The scraper accepts a JSON input defining the target URLs and scraping behavior.
| Parameter | Type | Required | Description |
|---|---|---|---|
startUrls | Array | Yes | A list of URLs to scrape (Homepage, Collection, or Product URLs). |
proxy | Object | Yes | Proxy configuration. Residential proxies are highly recommended to avoid blocks. |
maxRequestsPerCrawl | Integer | No | Limit the number of products scraped. Set to 0 for unlimited (default 100). |
maxRecommendationsPerProduct | Integer | No | Number of recommended products to fetch per product. Set to 0 to disable (default 0). Max 20. |
query | String | No | Search query to find specific products. |
Input Examples
| Use Case | Input JSON |
|---|---|
| Scrape all products from a store | { "startUrls": [{ "url": "https://kith.com" }], "maxRequestsPerCrawl": 0, "proxy": { "useApifyProxy": true } } |
| Scrape products from a collection | { "startUrls": [{ "url": "https://kith.com/collections/kith-tops" }], "maxRequestsPerCrawl": 0, "proxy": { "useApifyProxy": true } } |
| Scrape a single product page | { "startUrls": [{ "url": "https://kith.com/products/kith-williams-iii-hoodie-black" }], "proxy": { "useApifyProxy": true } } |
| Search products by keyword | { "startUrls": [{ "url": "https://kith.com" }], "query": "hoodie", "proxy": { "useApifyProxy": true } } |
| Fetch product with recommendations | { "startUrls": [{ "url": "https://kith.com/products/kith-williams-iii-hoodie-black" }], "maxRecommendationsPerProduct": 10, "proxy": { "useApifyProxy": true } } |
| Limit total scraped results | { "startUrls": [{ "url": "https://kith.com" }], "maxRequestsPerCrawl": 100, "proxy": { "useApifyProxy": true } } |
| Scrape with custom currency | { "startUrls": [{ "url": "https://kith.com/collections/kith-tops?currency=EUR" }], "proxy": { "useApifyProxy": true } } |
3. Output
Data is stored in the default dataset. The scraper outputs either Product or Collection objects.
Troubleshooting
| Issue | Possible Cause | Solution |
|---|---|---|
| 0 Results Found | The site may not be Shopify-based or has strong anti-bot protection. | Verify with the /admin trick. Try using residential proxies. |
| Access Denied / 403 | Your IP has been flagged. | Enable useApifyProxy and ensure you have sufficient proxy quota. |
| Incorrect Price | Currency mismatch or raw integer format. | Remember prices are x100 (e.g., 2000 = 20.00). Ensure ?currency=XYZ param is used if supported. |
TODO
- Review fetch support
- Real stock monitoring
- 7/30 day sales estimation
