Yahoo News Scraper

Pricing

Rating

Developer

Actor stats

Categories

Share

🚀 Yahoo News Scraper

Extract news articles from Yahoo News categories. The Yahoo News Scraper fetches articles from RSS feeds and scrapes full article details including title, author, publication date, and the complete article body.

✨ Features

• 📰 Full Article Extraction: Retrieve title, author, publication date, source, description, image URL, and full article body.
• 📂 Category-Based Scraping: Provide any Yahoo News category URL (e.g., /science/, /world/, /politics/) to scrape its articles.
• 🔗 RSS-Powered Discovery: Automatically discovers articles via Yahoo News RSS feeds for reliable and fast article enumeration.
• ⚙️ Configurable Limits: Control the maximum number of articles scraped per category.

🛠️ How It Works

1. Enter Category URLs – Provide one or more Yahoo News category URLs (e.g., https://news.yahoo.com/science/).
2. Set Article Limit – Optionally configure the maximum number of articles to scrape (default: 50).
3. Run the Scraper – The Actor fetches the RSS feed for each category, discovers articles, and extracts structured data from each one.

📥 Input

📊 Sample Output Data

The scraper provides structured JSON output with key article details. Example:

[
{
"url":"https://news.yahoo.com/science/article-example-123.html",
"title":"Scientists Discover New Deep-Sea Species in Pacific Ocean",
"author":"Jane Smith",
"publishedAt":"2025-03-15T14:30:00Z",
"source":"Associated Press",
"description":"Researchers have identified a previously unknown species living near hydrothermal vents.",
"imageUrl":"https://s.yimg.com/ny/api/res/1.2/example-image.jpg",
"articleBody":"A team of marine biologists has announced the discovery of a new species of deep-sea creature..."
},
{
"url":"https://news.yahoo.com/science/article-example-456.html",
"title":"NASA Announces New Mars Mission Timeline",
"author":"John Doe",
"publishedAt":"2025-03-14T09:15:00Z",
"source":"Reuters",
"description":"The space agency has outlined an updated schedule for its next Mars exploration program.",
"imageUrl":"https://s.yimg.com/ny/api/res/1.2/example-image-2.jpg",
"articleBody":"NASA officials revealed today that the agency's next Mars mission will launch in late 2028..."
}
]

Stay on top of the latest news with Yahoo News Scraper today! 🚀