Google News Scraper — Articles & Sources

Pricing

Rating

Developer

Actor stats

Categories

Share

Extract structured news article data from Google News by keyword, topic, or URL — no login, API key, cookies, or browser required. Built for developers, data teams, AI/LLM pipelines, and automated news monitoring workflows.

Runs on Apify — schedule it, call it via API, chain it with other actors, or integrate it directly into your MCP-compatible AI agent.

What It Does

This actor fetches Google News RSS feeds, parses them into clean structured records, and optionally visits article pages to extract full body text. Each run produces a consistent JSON dataset you can export to CSV, Excel, JSON, or push to any downstream system.

Output fields per article: title, source_name, source_url, google_news_url, published_at, description, image_url, search_query, topic, full_text, word_count, scraped_at

Key Features

No login or API key required — works out of the box with no authentication setup.

Bulk keyword search — pass multiple search queries in one run. Each query gets its own RSS feed and result set. Run 50 queries in a single call.

Built-in topic sections — monitor World, Technology, Business, Science, Health, Sports, Entertainment, or Nation headlines with a single click.

50+ region/language editions — scrape Google News in any edition: US English, German, French, Japanese, Arabic, Spanish, and 45+ more. Every language correctly sets hl, gl, and ceid parameters.

Google search operators supported — use quotes for exact phrases, minus to exclude terms, OR for alternatives, and site: to filter by publisher:

Time range filtering — filter by past hour, 24 hours, 7 days, 30 days, or 1 year.

Full article text extraction — optionally visit each article URL and extract the full body text. Produces full_text and word_count fields. Designed for AI/RAG pipelines, sentiment analysis, and NLP workloads.

Deduplication — across multiple queries and topics, duplicate articles are removed automatically.

Custom topic URLs — paste any Google News section URL to extract niche topic feeds not covered by built-in sections.

Structured output schema — fully defined dataset schema with typed fields, descriptions, and examples. MCP-compatible: field names and descriptions are optimized for LLM tool-use routing.

Input Options

Output Schema

Each article record has these fields:

Usage Examples

Monitor a brand or topic daily

{
"searchQueries":["OpenAI","Anthropic","Google DeepMind"],
"maxResultsPerQuery":20,
"timeRange":"1d",
"deduplicateResults":true
}

Collect top headlines across sections

{
"topics":["TECHNOLOGY","BUSINESS","SCIENCE","HEALTH"],
"maxResultsPerQuery":10
}

AI/RAG pipeline — full text extraction

{
"searchQueries":["large language models","AI regulation EU"],
"maxResultsPerQuery":15,
"extractFullText":true,
"timeRange":"7d"
}

Monitor non-English news

{
"searchQueries":["Künstliche Intelligenz","Bundesliga"],
"regionLanguage":"DE:de",
"maxResultsPerQuery":25
}

Bulk competitive intelligence

{
"searchQueries":[
"Tesla earnings","Ford EV","GM electric",
"Rivian news","Lucid Motors","NIO stock",
"BYD sales","Volkswagen EV","BMW electric","Mercedes EV"
],
"maxResultsPerQuery":10,
"timeRange":"7d",
"deduplicateResults":true
}

Performance & Cost

Example costs:

• 100 articles (metadata): $0.30
• 100 articles (with full text): $0.80
• 1,000 articles (metadata only): $3.00
• Daily monitoring, 10 queries × 20 articles: $0.60/day

Google News RSS returns up to 100 articles per feed. A single run with 10 search queries can collect up to 1,000 articles.

API & MCP Integration

Call via Apify API

curl-X POST "https://api.apify.com/v2/acts/khadinakbar~google-news-scraper/runs?token=YOUR_TOKEN"\
-H"Content-Type: application/json"\
-d'{"searchQueries": ["artificial intelligence"], "maxResultsPerQuery": 10}'

Use in an AI agent (MCP)

This actor is optimized for use via the Apify MCP server. When an LLM agent calls call-actor with khadinakbar/google-news-scraper, the structured input schema and output schema enable precise tool-use routing without hallucination.

Typical LLM agent prompt:

"Get the latest 10 news articles about AI regulation from the past week using Google News"

Agent call:

{
"searchQueries":["AI regulation"],
"maxResultsPerQuery":10,
"timeRange":"7d"
}

Comparison vs. Competitors

Notes

• source_url may be null for some articles. Google News encodes article URLs using a Base64 scheme that requires JavaScript to decode. The decodeUrls option attempts HTTP redirect following but cannot resolve all URLs. The google_news_url field is always populated and can be used to visit the article in a browser.
• full_text requires source_url to be resolvable. Articles where source_url is null will have full_text: null even when extractFullText is enabled.
• Rate limits: Google News RSS feeds are public and rate-limit tolerant. This actor runs within safe request limits.
• No blocked content: This actor only fetches publicly available RSS data and article pages. It does not bypass paywalls.

Frequently Asked Questions

How many articles can I scrape with Google News Scraper?

There is no hard cap. Each run is bounded by your maxResults input and the news available for the query, topic, or URL you provide. For very large monitoring jobs, split queries by topic, country, or time window and orchestrate them via the Apify API or scheduler.

Can I integrate Google News Scraper with other apps?

Yes. The actor pushes structured JSON to an Apify dataset, which integrates natively with Zapier, Make, n8n, Google Sheets, Airtable, and webhooks. You can also export CSV/JSON/XLSX for BI tools, RAG pipelines, or warehouses like BigQuery and Snowflake.

Can I use Google News Scraper with the Apify API?

Yes. Start runs, fetch dataset items, and stream output via the Apify REST API or any official SDK (JavaScript, Python). The "API & MCP Integration" section above shows the exact endpoints and parameters.

Can I use Google News Scraper through an MCP Server?

Yes. The actor is MCP-ready and can be called from Claude, Cursor, or any MCP-compatible agent via the Apify Actors MCP server. Tool names and input schema follow the standard Apify MCP conventions.

Do I need proxies to scrape Google News?

No. The actor uses Google News RSS feeds and public article pages, so no proxy configuration is required for typical workloads. Heavy-volume users can still attach Apify Proxy via input if they want extra rotation.

Is it legal to scrape Google News data?

This actor only fetches publicly available RSS feeds and article URLs. You are responsible for complying with Google's Terms of Service, the source publishers' terms, copyright law, and any regulations that apply in your jurisdiction (e.g. GDPR, CCPA). Do not use the output to redistribute full article text in ways that infringe publisher rights.

Your feedback

Found an issue, missing field, or have a feature request? Open an Issue on the actor page — feedback directly shapes the next release.

Related actors

• Google SERP Scraper — Pair news coverage with full Google search results, snippets, and PAA.
• Google Trends Scraper — Correlate news volume with search interest over time.
• Google AI Overviews Scraper — See which news sources Google's AI Overviews cite for the same topics.
• Brand Sentiment Analyzer — Score sentiment across the news mentions you collect here.
• Google Finance Stock News Scraper — Drill into ticker-specific financial news on top of general Google News.