Pricing

Rating

Developer

Actor stats

Categories

Share

AI-Ready Web Page to Markdown Converter

This project is a page-to-Markdown converter designed for use with Apify Actors. It crawls web pages starting from user-provided URLs, follows links up to a specified depth, and converts the content of each page into Markdown format.

Features

• Input-driven crawling: Start from one or more URLs.
• Configurable crawl depth: Control how deep the crawler follows links.
• Request limits: Set a maximum number of requests per crawl.
• Automatic Markdown conversion: Extracts and converts web page content to Markdown.

Input

The actor expects the following input:

exportinterfaceInput{
 startUrls:{
 url:string;
}[];// List of URLs to start crawling from
 maxRequestsPerCrawl:number;// Maximum number of requests per crawl
 depth:number;// How deep to follow links from the start URLs
}

Usage

1. Configure Input:
   Provide your startUrls, maxRequestsPerCrawl, and depth in the input.

2. Run the Actor:
   Deploy and run the actor on Apify or locally.

3. Get Markdown Output:
   The actor will output the crawled pages in Markdown format.

Example Input

{
"startUrls":[
{
"url":"https://example.com"
}
],
"maxRequestsPerCrawl":10,
"depth":2
}

Output

• Markdown files for each crawled page, ready for further processing or publishing.

License

MIT