Pricing

Rating

Developer

Actor stats

Categories

Share

edX Course Data Scraper

Extract comprehensive course data from edX quickly and reliably. Collect titles, organizations, durations, levels, languages, and more at scale. Ideal for research, analysis, and monitoring educational offerings over time.

Features

• Keyword search — Gather course data by topic or skill
• Language filtering — Focus on specific languages as needed
• Automatic pagination — Collect large result sets without manual paging
• Structured output — Ready for analytics, dashboards, and exports
• Scalable collection — Designed for small tests or large datasets

Use Cases

Market Research

Track trends across subjects, providers, and course levels to understand demand and gaps in the catalog.

Curriculum Planning

Compare offerings across institutions to design programs that align with current learning needs.

Competitive Intelligence

Monitor course listings over time and identify shifts in topics, focus areas, and availability.

Data Analysis

Build datasets for BI, reporting, or custom data science workflows.

Input Parameters

Output Data

Each item in the dataset contains:

Usage Examples

Basic Extraction

{
"keyword":"data science",
"results_wanted":50
}

Language-Specific Collection

{
"keyword":"python",
"language":"English",
"results_wanted":100
}

Large Dataset with Safety Cap

{
"keyword":"business",
"results_wanted":200,
"max_pages":5
}

Sample Output

{
"title":"CS50's Introduction to Programming with Python",
"url":"https://www.edx.org/learn/python/harvard-university-cs50-s-introduction-to-programming-with-python",
"organization":"Harvard University",
"level":["Introductory"],
"language":["English"],
"short_description":"An introduction to programming using Python, a popular language for general-purpose programming, data science, web programming, and more.",
"image_url":"https://prod-discovery.edx-cdn.org/media/course/image/2cc794d0-316d-42f7-bbfd-25c34e4cd5df-033e46d516c0.png",
"subjects":["Computer Science","Data Analysis & Statistics"],
"weeks_to_complete":10,
"min_effort":3,
"max_effort":9,
"enrollment_count":147611,
"marketing_url":"https://www.edx.org/learn/python/harvard-university-cs50-s-introduction-to-programming-with-python",
"external_url":null,
"partner":["Harvard University"],
"partner_keys":["HarvardX"],
"program_type":["Professional Certificate","Professional Certificate"],
"learning_type":["Course","Professional Certificate","Professional Certificate"],
"tags":[],
"skills":[
{"skill":"Debugging","category":"Information Technology","subcategory":"Software Development"}
]
}

Tips for Best Results

Choose Clear Keywords

• Use specific topics for more relevant results
• Try variations of terms for broader coverage

Optimize Collection Size

• Start with 20–50 items for testing
• Increase results_wanted for larger datasets

Use Proxies for Stability

• Residential proxies improve reliability on large runs

Integrations

Connect your data with:

• Google Sheets — Export for analysis
• Airtable — Build searchable databases
• Slack — Get notifications
• Webhooks — Send to custom endpoints
• Make — Create automated workflows
• Zapier — Trigger actions

Export Formats

• JSON — For developers and APIs
• CSV — For spreadsheet analysis
• Excel — For business reporting
• XML — For system integrations

Frequently Asked Questions

How many courses can I collect?

You can collect all available results. The practical limit depends on your requested size and run duration.

Can I filter by language?

Yes, use the language parameter to target specific languages.

Does the actor handle pagination automatically?

Yes, pagination is handled automatically up to your requested limit.

What if some fields are missing?

Some courses may not provide all fields, so empty values are possible.

Can I run this on a schedule?

Yes, schedule runs in the Apify Console for continuous monitoring.

Support

For issues or feature requests, contact support through the Apify Console.

Resources

• Apify Documentation
• API Reference
• Scheduling Runs

Legal Notice

This actor is designed for legitimate data collection purposes. Users are responsible for ensuring compliance with website terms of service and applicable laws. Use data responsibly and respect rate limits.