Pricing

Rating

Developer

Actor stats

Categories

Share

🔍 Google Search Scraper — SERP Results

Scrape Google Search Engine Results Pages (SERPs) for any query. Extract organic results, People Also Ask, related searches, featured snippets, and knowledge panels.

2x cheaper than competitors. Pay just $0.003 per search — most alternatives charge $0.006–$0.012+.

✨ What You Get

🚀 Use Cases

• SEO Analysis — Track keyword rankings across countries and languages
• Keyword Research — Discover related searches and PAA questions to target
• Competitor Monitoring — See who ranks for your target keywords
• Content Strategy — Find featured snippet opportunities
• Market Research — Analyze search landscapes for any industry
• Lead Generation — Find businesses ranking for specific services

💰 Pricing Comparison

Save 50%+ on your SERP data costs.

📥 Input

{
"queries":["best CRM software","project management tools"],
"resultsPerPage":10,
"language":"en",
"country":"us",
"maxPages":1
}

📤 Output Example

[
{
"searchQuery":"best CRM software",
"position":1,
"title":"The 10 Best CRM Software for 2026 - Forbes",
"url":"https://www.forbes.com/advisor/business/software/best-crm-software/",
"description":"We evaluated dozens of CRM platforms to find the best options for small businesses, enterprises, and every team in between.",
"type":"organic",
"page":1
},
{
"searchQuery":"best CRM software",
"position":0,
"title":"What is the best CRM for small businesses?",
"url":"",
"description":"",
"type":"people_also_ask",
"page":1
},
{
"searchQuery":"best CRM software",
"position":0,
"title":"best free crm software",
"url":"",
"description":"",
"type":"related_search",
"page":1
}
]

🌍 Supported Countries & Languages

Works with any Google-supported country code (gl parameter) and language code (hl parameter):

• Countries: us, uk, ca, au, de, fr, es, it, br, in, jp, kr, and 100+ more
• Languages: en, fr, de, es, pt, it, nl, ja, ko, zh, ar, and 50+ more

⚡ Features

• GDPR bypass — Automatically handles EU consent screens
• Anti-blocking — Rotating user agents, random delays, exponential backoff on rate limits
• Pagination — Scrape multiple SERP pages per query
• Lightweight — Minimal dependencies (httpx only, no browser needed)
• Fast — HTTP-based scraping, no headless browser overhead
• Pay per event — Only pay for successful searches, not compute time

🔧 Technical Details

• Uses direct HTTP requests (no Playwright/Puppeteer)
• Parses raw HTML with regex for zero-dependency performance
• Handles HTTP 429 with exponential backoff (up to 3 retries)
• Random delays between requests (1–4s) to avoid detection
• Supports Google's various HTML layouts and class names

📋 Tips

1. Start small — Test with 1 query before running bulk jobs
2. Use pagination wisely — Most useful results are on page 1
3. Localize — Set country + language to get region-specific results
4. Batch queries — More efficient than running separate tasks per query
5. Monitor results — Google's HTML structure changes occasionally; report issues

🐛 Limitations

• Google may serve CAPTCHAs or JS-only pages under heavy use or from datacenter IPs — the actor retries but can't solve them. On Apify's infrastructure with residential proxies, this works reliably.
• HTML class names change — we use multiple fallback patterns to cover various layouts, but Google's markup evolves.
• Knowledge panel extraction may be incomplete for complex entities.
• Featured snippets vary widely in format; we extract the visible text but structured data is not guaranteed.
• No guaranteed scraping — Use at your own risk; Google's TOS applies.

🧪 Local Testing

Important: Google often serves JavaScript-only pages to datacenter IPs, which will result in no parseable results when running locally on a VPS. The actor is designed to run on Apify's platform with residential proxies, where it works reliably.

To test the parser locally with a saved HTML file:

# Save a real Google SERP HTML to file (e.g., using a browser's Save As)
python3 -m tests.run sample.html

Or write a quick script:

from src.main import parse_organic_results, parse_people_also_ask, parse_related_searches
withopen('sample.html')as f:
 html = f.read()
organic = parse_organic_results(html,'test query',1)
print(f'Organic: {len(organic)} results')

📦 What's Inside

google-serp-scraper/
├── .actor/
│ ├── actor.json # Actor metadata
│ ├── input_schema.json # Input configuration UI
│ └── pay_per_event.json # $0.003 per search event
├── src/
│ ├── __init__.py
│ ├── __main__.py
│ └── main.py # Scraper logic
├── requirements.txt # Dependencies: apify, httpx
├── Dockerfile # Apify Python 3.12 base
└── README.md # This file

🔒 Disclaimer

This actor is provided as-is. Use responsibly and respect Google's Terms of Service. The author is not responsible for any blocks, CAPTCHAs, or legal issues arising from misuse.

📄 License

MIT

📄 License

MIT

🔗 Integration Examples

Python

from apify_client import ApifyClient
client = ApifyClient("YOUR_API_TOKEN")
run = client.actor("joyouscam35875/google-serp-scraper").call(run_input={"queries":["best tools 2026"],"resultsPerPage":10})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)

Node.js

import{ ApifyClient }from'apify-client';
const client =newApifyClient({token:'YOUR_API_TOKEN'});
const run =await client.actor('joyouscam35875/google-serp-scraper').call({"queries":["best tools 2026"],"resultsPerPage":10});
const{ items }=await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

Make / Zapier / n8n

Use the Apify integration — search for this actor by name in the Apify app connector. No code needed.

🔗 More Scrapers by Ken Digital

👉 View all scrapers

⚠️ Important: Residential Proxies Required

This actor targets platforms with strict anti-bot protection (Cloudflare, fingerprinting). To successfully scrape data, you must enable Apify Residential Proxies in the actor settings. Go to the Apify Console → Actor → Settings → Proxy configuration → select Residential proxy pool. Without residential proxies, the actor will return 0 results or errors. ✅ Pro tip: The actor is configured for pay-per-event pricing, so you only pay for successful results.