VOOZH about

URL: https://apify.com/jakub.kopecky/crewai-mcp-tester

⇱ CrewAI MCP Tester Β· Apify


Pricing

Pay per usage

Go to Apify Store

Automated Model Context Protocol (MCP) server testing tool. Connects to MCP servers, tests available tools using CrewAI agent, and generates detailed reports with pass/fail status. Supports custom authentication headers.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

πŸ‘ Jakub KopeckΓ½

Jakub KopeckΓ½

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

0

Monthly active users

9 months ago

Last modified

Share

It is important to ensure that your MCP server is functioning correctly and that all tools are available and working as expected. This Actor automates the manual testing process and provides a detailed report on the status of each tool.

Since MCP servers are often used in agentic-based applications, it is essential to test the MCP server using an agentic approach.

ℹ️ Notice:
This Actor internally uses the Apify Openrouter Actor to call an LLM. You will be billed for LLM usage through this Actor.

πŸ”₯ Features

  • Connects to MCP servers via URL and tests all available tools
  • Uses GPT-4.1 Mini to interact with MCP tools and evaluate responses
  • Generates test reports with pass/fail status and findings
  • Supports custom headers for authentication
  • Token-based pricing model using Pay per Event
  • Runs on Apify platform

πŸ“Š Output data

The Actor returns individual records for each tool tested. Each record contains:

FieldTypeDescription
nameStringName of the MCP tool that was tested
passedBooleanWhether the tool test passed (true/false)
detailStringTesting scenario description or explanation of failure

πŸš€ Usage

  1. Navigate to the Actor page
  2. Provide the MCP server URL
  3. Add authentication headers for the MCP server (if required)
  4. Start the test
  5. Review the generated report

πŸ’° Pricing

You will be charged based on LLM token usage. For a simple MCP server with a few tools, the cost should be under $0.05 per test run.

πŸ’Ύ Input

The Actor accepts the following input parameters:

{
"mcpUrl":"https://your-mcp-server.com/mcp",
"headers":{
"Authorization":"Bearer your-token",
"X-Custom-Header":"custom-value"
}
}

Parameters:

  • mcpUrl (required): MCP server endpoint URL
  • headers (optional): HTTP headers for authentication or configuration

πŸ”’ Output

The Actor returns individual records for each tool tested. Each record is a separate JSON object:

[
{
"name":"get-actor-details",
"passed":true,
"detail":"Successfully retrieved detailed information about the actor 'apify/proxy-test'."
},
{
"name":"search-actors",
"passed":true,
"detail":"Successfully searched for actors with the keyword 'test' and received valid results."
},
{
"name":"search-apify-docs",
"passed":true,
"detail":"Successfully searched Apify documentation for the keyword 'test' and received relevant documentation links."
},
{
"name":"fetch-apify-docs",
"passed":true,
"detail":"Successfully fetched full content of an Apify documentation page about automated testing."
},
{
"name":"add-actor",
"passed":true,
"detail":"Successfully added the actor 'apify/proxy-test' to the available tools."
},
{
"name":"apify-slash-rag-web-browser",
"passed":true,
"detail":"Successfully ran a basic operation querying 'san francisco weather' and received results without errors."
}
]

πŸ”§ Configuration

Custom headers

For MCP servers requiring authentication:

{
"mcpUrl":"https://secure-mcp-server.com/mcp",
"headers":{
"Authorization":"Bearer your-secure-token",
"X-API-Key":"your-api-key",
}
}

🌐 Open source

This Actor is open source and available on GitHub.

πŸ“š Resources

You might also like

OpenAI Agent MCP Tester

jiri.spilka/openai-agent-mcp-tester

Automated Model Context Protocol (MCP) server testing and evaluation tool using openai-agents SDK. Connects to multiple MCP servers via HTTP streaming, tests available tools using AI agents, and generates detailed reports with pass/fail status for each server. Supports custom authentication headers

πŸ‘ User avatar

JiΕ™Γ­ Spilka

10

Tester MCP Client

jiri.spilka/tester-mcp-client

A model context protocol (MCP) client that connects to any MCP server using Streamable HTTP and displays the conversation in a chat-like UI. It is a standalone Actor server designed for testing MCP servers over Stremable HTTP.

πŸ‘ User avatar

JiΕ™Γ­ Spilka

1.4K

5.0

Time MCP Server

agentify/time-mcp-server

An MCP server implementing the Model Context Protocol (MCP) for time-related operations.

Mcp Validator

rocketagro/mcp-validator

**MCP Validator** is a professional validation and compliance testing tool for [Model Context Protocol (MCP)](https://modelcontextprotocol.io) servers. It ensures your MCP server’s **tools, resources, prompts, and templates** are correct, compliant, and production-ready.

Web Search MCP Server

abotapi/ai-search-mcp-server

An Apify MCP Server that provides real-time web search capabilities for AI agents via the Model Context Protocol (MCP).

MCP Stress Tester

jakub.kopecky/mcp-stress-tester

A simple MCP Stress Tester client Actor for stress-testing your Model Context Protocol server. πŸ’»βš‘

πŸ‘ User avatar

Jakub KopeckΓ½

6

Playwright MCP Server

jiri.spilka/playwright-mcp-server

A Model Context Protocol (MCP) server that provides browser automation capabilities using Playwright

πŸ‘ User avatar

JiΕ™Γ­ Spilka

312

Related articles

Build and deploy MCP servers in minutes with a TypeScript template
Read more
Best MCP servers for developers
Read more
How to use MCP with Apify Actors
Read more