Article Content Extractor

Pricing

Rating

Developer

Actor stats

Categories

Share

Extract clean article content, metadata, images, and structured data from any web page URL. Provides title, description, author, publish date, plain text content, word count, reading time, images, links, and JSON-LD structured data.

Features

• Extracts article body using Readability-like algorithm (tries <article>, [itemprop="articleBody"], .post-content, main, etc.)
• Parses all meta tags: Open Graph, Twitter Cards, standard HTML meta
• Extracts JSON-LD Schema.org structured data (Article, NewsArticle, BlogPosting, etc.)
• Detects author, publish date, modified date, section, tags, and language
• Collects image list with dimensions (up to 50 images)
• Optionally gathers internal & external links
• Calculates word count and estimated reading time (200 WPM)
• Works with news sites, blogs, Wikipedia, Medium, and most static/SSR pages

Input

Example Input

{
"urls":[
"https://en.wikipedia.org/wiki/Artificial_intelligence",
"https://www.bbc.com/news"
],
"includeImages":true,
"includeLinks":true,
"includeHtml":false,
"extractSchema":true
}

Output

Each URL produces one dataset item:

{
"position":1,
"url":"https://en.wikipedia.org/wiki/Artificial_intelligence",
"title":"Artificial intelligence - Wikipedia",
"description":"Artificial intelligence (AI) is the intelligence of machines...",
"author":null,
"publishDate":null,
"modifiedDate":null,
"section":null,
"tags":["technology","science"],
"language":"en",
"siteName":null,
"canonical":"https://en.wikipedia.org/wiki/Artificial_intelligence",
"domain":"en.wikipedia.org",
"content":"From Wikipedia, the free encyclopedia...",
"contentHtml":null,
"wordCount":30000,
"readingTimeMinutes":150,
"ogImage":null,
"images":[
{"src":"https://upload.wikimedia.org/...","alt":"AI illustration","width":350,"height":230}
],
"internalLinks":[{"text":"Machine learning","href":"https://en.wikipedia.org/wiki/Machine_learning"}],
"externalLinks":[{"text":"Nature paper","href":"https://www.nature.com/..."}],
"schemaData":{"@type":"Article","name":"Artificial intelligence"},
"favicon":"https://en.wikipedia.org/favicon.ico",
"scrapedAt":"2025-01-01T00:00:00.000Z"
}

Dataset Views

Known Limitations

• Paywalled / login-required sites: Actor extracts whatever is publicly visible. Pages behind auth walls may return empty content.
• Heavy JavaScript SPAs: Content rendered by client-side JavaScript (React, Vue) may not be fully extracted. The actor waits up to 15 seconds for content to appear before extracting.
• Author field on Wikipedia: Wikipedia pages list the authority control section as the "author", since there is no standard author meta tag. This is a limitation of relying solely on meta tags.
• Cloudflare / Bot-protected sites: Sites protected by Cloudflare Managed Challenge, DataDome, or PerimeterX will return empty or error results. Use residential proxies to improve success rate. See the ../.github/instructions/anti-bot-bypassing.instructions.md.

Proxy

Residential proxies are recommended for news sites and paywalled content:

{
"proxyConfiguration":{
"useApifyProxy":true,
"apifyProxyGroups":["RESIDENTIAL"]
}
}