Pricing

Rating

Developer

Actor stats

Categories

Share

Smart URL Data Extractor

Intelligent web scraping Actor that automatically detects content types and extracts structured data from any URL.

🚀 Features

• Automatic Content Detection: Identifies if a URL contains products, job listings, articles, or profiles
• Intelligent Data Extraction: Extracts 15+ relevant fields based on detected content type
• Multiple Content Types Supported:
  • 🛍️ Products: price, brand, rating, images, availability, SKU
  • 💼 Jobs: title, company, location, salary, description, employment type
  • 📰 Articles: headline, author, publish date, content, tags, category
  • 👤 Profiles: name, bio, avatar, location, social links

📥 Input Configuration

{
"startUrls":[
{"url":"https://example.com/product"}
],
"maxConcurrency":5,
"outputFormat":"json"
}

Parameters:

• startUrls (required): Array of URLs to scrape
• maxConcurrency (optional): Max number of concurrent requests (default: 5)
• outputFormat (optional): Output format - "json" or "csv" (default: "json")

📤 Output

The Actor returns structured JSON data with automatically detected fields based on content type.

Example Output (Product):

{
"type":"product",
"url":"https://example.com/product",
"title":"Product Name",
"price":"$99.99",
"brand":"Brand Name",
"rating":"4.5 stars",
"availability":"In Stock",
"detectedType":"product",
"extractedAt":"2025-11-23T19:13:16.454Z"
}

🛠️ Use Cases

• E-commerce price monitoring
• Job board aggregation
• Content curation and analysis
• Profile data collection
• Competitive intelligence

📖 Documentation

For detailed documentation, visit Apify Docs

👨‍💻 Author

Created by Diao-Bah-timbi

📝 License

Open-source (Apache 2.0)