ai-gateway

Here are 304 public repositories matching this topic...

Kong / kong

🦍 The API and AI Gateway

kubernetes devops microservices ai microservice serverless api-management api-gateway mcp reverse-proxy artificial-intelligence apis cloud-native kubernetes-ingress kubernetes-ingress-controller openai-proxy llm-ops ai-gateway llm-gateway mcp-gateway

Updated
Lua

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

gateway bedrock openai vertex-ai azure-openai llm langchain llmops anthropic openai-proxy litellm ai-gateway llm-gateway mcp-gateway

Updated
Python

QuantumNous / new-api

Star

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management. 🍥

gemini openai claude newapi ai-gateway deepseek rerank

Updated
Go

casdoor / casdoor

Sponsor

Star

An open-source AI-first Identity and Access Management (IAM) /AI MCP & agent gateway and auth server with web UI supporting MCP, A2A, OAuth 2.1, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

agent ldap oauth saml authentication mcp iam auth radius sso oidc mfa scim single-sign-on webauthn casdoor ai-gateway llm-gateway mcp-gateway agent-skill

Updated
Go

👁 gateway

Portkey-AI / gateway

Star

A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

mcp gateway openai hacktoberfest llm llms generative-ai langchain llmops ai-gateway llm-gateway mcp-servers mcp-client mcp-gateway model-router

Updated
TypeScript

👁 coai

coaidev / coai

Star

🚀 Next Generation Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

react api chat golang cross-platform proxy gemini openai chatgpt ai-gateway llm-gateway

Updated
TypeScript

alibaba / higress

Star

🤖 AI Gateway | AI Native API Gateway

api-gateway cloud-native envoy ai-native ai-gateway

Updated
Go

katanemo / plano

Star

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

proxy routing gateway prompt proxy-server openai envoy envoyproxy llms generative-ai llmops llm-inference llm-proxy ai-gateway llm-gateway llm-routing ai-gateway-support

Updated
Rust

octelium / octelium

Star

A next-gen FOSS self-hosted unified zero trust secure access platform that can operate as a remote access VPN, a ZTNA platform, API/AI/MCP gateway, a PaaS, an ngrok-alternative and a homelab infrastructure.

kubernetes tunnel ssh api-gateway paas vpn sso quic mfa remote-access abac homelab wireguard zero-trust beyondcorp policy-as-code opentelemetry ztna ai-gateway mcp-gateway

Updated
Go

vllm-project / semantic-router

Sponsor

Star

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

kubernetes rust golang mcp fine-tuning pii-detection mixture-of-models huggingface-transformers bert-classification llm prompt-engineering vllm huggingface-candle ai-gateway semantic-router prompt-guard llmrouter openclaw

Updated
Go

maximhq / bifrost

Star

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

gateway load-balancing token-management guardrails gateway-services llm generative-ai llmops ai-gateway llm-observability llm-cost llm-gateway mcp-server mcp-client mcp-gateway model-router

Updated
Go

krakend / krakend-ce

Star

KrakenD Community Edition: High-performance, stateless, declarative, API Gateway written in Go.

go graphql docker golang microservices microservice async api-gateway nats reverse-proxy backend-services apis cloud-native ai-gateway

Updated
Go

agentgateway / agentgateway

Star

Next Generation Agentic Proxy for AI Agents and MCP servers

kubernetes rust ai api-gateway mcp reverse-proxy service-mesh agents gateway-api ai-gateway mcp-gateway

Updated
Rust

bestruirui / octopus

Star

One Hub All LLMs For You | 为个人打造的 LLM API 聚合服务

ai self-hosted openai codex claude anthropic ai-gateway llm-gateway claude-code

Updated
TypeScript

kaitranntt / ccs

Sponsor

Star

Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.

nodejs oauth typescript gemini websearch claude cli-tool multi-account react-dashboard developer-productivity github-copilot openrouter ai-gateway anthropic-api claude-code cliproxyapi profile-switching

Updated
TypeScript

APIParkLab / APIPark

Star

Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关，LLM API 管理、分发系统、开放平台，支持所有AI API，不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 请求和返回，API申请与审批，调用统计、负载均衡、多模型灾备。一键部署，开箱即用。

api ai api-gateway gateway openai developer-portal api-platform api-portal claude apihub qwen ai-gateway deepseek llm-gateway

Updated
TypeScript

nextlevelbuilder / goclaw

Star

GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.