Build Voice Agents in ElevenLabs with access to Live FHIR Data

ElevenLabs is a leading AI audio platform that enables developers to build conversational voice agents capable of natural, human-like interactions. The ElevenLabs Conversational AI platform allows you to create voice-powered assistants that can reason through tasks, respond dynamically, and interact with external systems in real time.

By integrating ElevenLabs with CData Connect AI through the MCP (Model Context Protocol), your voice agents gain the ability to query, analyze, and act on live FHIR data during conversations. This integration bridges ElevenLabs' conversational AI framework with the governed enterprise connectivity of CData Connect AI, ensuring all data access runs securely against authorized sources without manual data movement.

This article outlines the steps to configure FHIR connectivity in Connect AI, generate the required authentication credentials, register the Connect AI MCP Server in ElevenLabs, and verify that your voice agent can successfully interact with live FHIR data during conversations.

Step 1: Configure FHIR connectivity for ElevenLabs

Connectivity to FHIR from ElevenLabs is made possible through CData Connect AI's Remote MCP Server. To interact with FHIR data from your voice agents, start by creating and configuring a FHIR connection in CData Connect AI.

1. Log into Connect AI, click Sources, and then click Add Connection
👁 Adding a connection in Connect AI

2. Select FHIR from the Add Connection panel
👁 Selecting data source

3. Enter the necessary authentication properties to connect to FHIR.

   Set URL to the Service Base URL of the FHIR server. This is the address where the resources are defined in the FHIR server you would like to connect to. Set ConnectionType to a supported connection type. Set ContentType to the format of your documents. Set AuthScheme based on the authentication requirements for your FHIR server.

   Generic, Azure-based, AWS-based, and Google-based FHIR server implementations are supported.

   Sample Service Base URLs

   • Generic: http://my_fhir_server/r4b/
   • Azure: https://MY_AZURE_FHIR.azurehealthcareapis.com/
   • AWS: https://healthlake.REGION.amazonaws.com/datastore/DATASTORE_ID/r4/
   • Google: https://healthcare.googleapis.com/v1/projects/PROJECT_ID/locations/LOCATION/datasets/DATASET_ID/fhirStores/FHIR_STORE_ID/fhir/

   Generic FHIR Instances

   The product supports connections to custom instances of FHIR. Authentication to custom FHIR servers is handled via OAuth (read more about OAuth in the Help documentation. Before you can connect to custom FHIR instances, you must set ConnectionType to Generic.

   👁 Configuring a connection (Salesforce is shown)
   
4. Click Save & Test
5. Navigate to the Permissions tab and update user-based permissions
👁 Updating permissions

Add a Personal Access Token

A Personal Access Token (PAT) is used to authenticate the connection to Connect AI from ElevenLabs. It is best practice to create a separate PAT for each integration to maintain granular access control.

1. Click the gear icon () at the top right of the Connect AI app to open Settings
2. On the Settings page, go to the Access Tokens section and click Create PAT
3. Give the PAT a descriptive name (e.g., "ElevenLabs Voice Agent") and click Create
👁 Creating a new PAT

4. Copy the token when displayed and store it securely. It will not be shown again

With the FHIR connection configured and a PAT generated, ElevenLabs can now connect to FHIR data through Connect AI.

Step 2: Add the Connect AI MCP Server in ElevenLabs

ElevenLabs supports connecting to external MCP servers that use SSE (Server-Sent Events) or HTTP streamable transport. The CData Connect AI Remote MCP Server is compatible with this integration.

1. Log into the ElevenLabs platform and navigate to your agent dashboard 👁 ElevenLabs agent dashboard
   
2. Go to Integrations and click + Add Integration to access the MCP server integrations section
3. Click on Custom MCP Server to add a new integration 👁 Adding a Custom MCP Server
   
4. Enter the following configuration:
   • Name: CData Connect AI
   • Description: Access live enterprise data from hundreds of sources
   • Server URL: https://mcp.cloud.cdata.com/sse
   • Secret Token: Leave empty (authentication is handled via headers)
   • HTTP Headers: Add a header with key Authorization and value Basic your_email:your_PAT
   👁 Configuring the CData Connect AI MCP server
   
5. Replace your_email:your_PAT with your Connect AI login email and the Personal Access Token you created earlier. For example: Basic [email protected]:ABC123...XYZ789
6. Click Save to test the connection and retrieve available tools from Connect AI
7. The CData Connect AI MCP server is now available to assign to your voice agents

Step 3: Configure your Voice Agent to use Connect AI

With the MCP server registered, you can now add it to your ElevenLabs voice agents to enable real-time data access during conversations.

1. Create a new agent or edit an existing agent in the ElevenLabs dashboard
2. In the agent configuration, navigate to the Tools section
3. Add the CData Connect AI MCP server you configured in Step 2 👁 Adding the MCP server to an agent
   
4. Configure the tool approval mode based on your requirements:
   • Always Ask: The agent will request permission before each data query (recommended for sensitive data)
   • Fine-Grained: Set approval requirements per tool/action
   • No Approval: The agent can query data autonomously
5. Save your agent configuration

Step 4: Interact with live data through your Voice Agent

Your ElevenLabs voice agent can now access and query live FHIR data through the CData Connect AI MCP Server during conversations.

1. Start a conversation with your voice agent 👁 Starting a conversation with your voice agent
   
2. Ask your agent data-related questions such as:
   • "What connections are available?"
   • "Show me the schemas for FHIR"
   • "Query recent records from FHIR data"
   • "Summarize our latest Data"
3. The agent will use the Connect AI MCP tools to retrieve live data and respond conversationally 👁 Voice agent responding with data from Connect AI
   

Your ElevenLabs voice agent is now fully configured to access and query live FHIR data through the CData Connect AI Remote MCP Server, enabling real-time, data-driven voice interactions for your users.

Get CData Connect AI

To access hundreds of SaaS, Big Data, and NoSQL sources through secure, AI-ready interfaces, try CData Connect AI today.