Pricing

Rating

Developer

Actor stats

Categories

Share

GitHub Repository → Markdown Converter

This Apify actor converts multiple GitHub repositories into clean, structured Markdown optimized for use with large language models (LLMs). It fetches files from GitHub repositories (optionally filtered by branch, extensions, or glob patterns), processes the content, and outputs Markdown suitable for embeddings, fine-tuning, or context augmentation.

Use this actor to transform codebases into LLM-ready documentation, research corpora, or preparation material for model pretraining or retrieval augmentation. Process single repositories or batch multiple repositories efficiently in one run.

Input Parameters

The actor accepts the following input parameters as a JSON object:

Repository Object Properties

Each repository object in the repositories array supports the following properties:

Example Input

Multiple Repositories

{
"repositories":[
{
"source":"https://github.com/facebook/react",
"branch":"main",
"extensions":[".js",".jsx",".ts",".tsx"],
"maxTokens":100000,
"maxFiles":250,
"includeFiles":["packages/react/src/**"],
"excludeFiles":["**/*.test.js","**/*.md"]
},
{
"source":"https://github.com/vercel/next.js",
"branch":"canary",
"extensions":[".js",".ts",".tsx"],
"maxTokens":150000,
"maxFiles":300,
"includeFiles":["packages/next/src/**"],
"excludeFiles":["**/*.test.js","**/*.spec.js"]
}
]
}

Single Repository

{
"repositories":[
{
"source":"https://github.com/facebook/react",
"branch":"main",
"extensions":[".js",".jsx",".ts",".tsx"],
"maxTokens":200000
}
]
}

Example Output

{
"repositoryIndex":0,
"repositoryUrl":"https://github.com/facebook/react",
"result":"<MARKDOWN CONTENT>"
}

Use Cases

The GitHub Repo → Markdown Converter can be used in multiple scenarios, such as:

• LLM Training Preparation
  Convert multiple repositories into token-friendly Markdown for fine-tuning or embeddings.

• Documentation Generation
  Produce readable markdown documents from source code across multiple projects.

• Research & Analysis
  Analyze and compare multiple repositories in LLM workflows by converting them into structured text.

• Knowledge Base Construction
  Build RAG (Retrieval-Augmented Generation) datasets from multiple live repositories in a single run.

• Codebase Summarization & Understanding
  Provide LLMs with high-quality, normalized code inputs from multiple projects for better comparative model reasoning.

• Batch Processing
  Process multiple related repositories (e.g., microservices, related libraries) efficiently in a single Actor run.

Related Actors

• GitHub Profile Scraper - Extract comprehensive GitHub user profile information
• GitHub Repository Scraper - Scrape detailed repository metadata and statistics

🌟 Explore More Actors

✨ Need more scraping solutions? Discover additional actors on Apify for comprehensive web automation and data extraction. Explore our full range of tools at 🌐 Explore More Actors on Apify.

📧 For inquiries or custom development, reach out at apify@vulnv.com.