Kong/kong
Kong Gateway is a cloud-native, scalable API gateway that manages API, AI LLM, and Model Context Protocol (MCP) traffic with advanced security, observability, and extensibility features.
alibaba/higress
Higress is a cloud-native AI native API gateway developed by Alibaba that supports hosting Model Context Protocol (MCP) servers. It enables unified management of AI and large language model (LLM) APIs with extensible WebAssembly (Wasm) plugins and enterprise-grade features. Built on Istio and Envoy, Higress offers a rich plugin ecosystem with support for Go, Rust, and JavaScript, providing dozens of ready-to-use general-purpose plugins and an out-of-the-box console for easy management. It supports all mainstream AI model providers, both domestic and international, and facilitates AI agents to call various tools and services through MCP servers hosted via its plugin mechanism. The project includes tools like openapi-to-mcp to convert OpenAPI specifications into remote MCP servers, enabling quick deployment and unified management of LLM and MCP APIs. Higress originated within Alibaba to address challenges such as Tengine reload issues affecting long-connection services and insufficient load balancing for gRPC/Dubbo. It is now a core component of Alibaba Cloud's API gateway product, supporting critical AI applications and providing high availability and robust load balancing for enterprise customers. The gateway supports Kubernetes ingress controller features, microservice gateway capabilities with integration to service registries like Nacos, ZooKeeper, Consul, and Eureka, and security gateway functions including WAF and multiple authentication strategies. Key advantages include production-grade reliability with millisecond configuration updates, true streaming processing for high-bandwidth AI scenarios, and easy extensibility through a rich plugin library. Higress supports unified authentication, fine-grained rate limiting, comprehensive audit logs, rich observability, and dynamic updates without disruption. It is designed to handle large-scale traffic with hundreds of thousands of requests per second, making it suitable for enterprise AI and microservice environments. The project provides Docker and Helm deployment options and maintains a secure image repository with Alibaba Cloud ACR integration. Overall, Higress is a powerful, extensible, and enterprise-ready AI gateway solution that simplifies the management and deployment of AI and MCP APIs, supporting modern cloud-native and microservice architectures.
https://github.com/alibaba/higress
Also in Gateways
IBM/mcp-context-forge
IBM/mcp-context-forge is a production-grade MCP Gateway that unifies and manages MCP and REST services, providing a secure, scalable, and feature-rich interface for AI clients.
open-webui/mcpo
mcpo is a secure and simple proxy server that exposes Model Context Protocol (MCP) tools as OpenAPI-compatible HTTP servers, enabling seamless integration with LLM agents and applications.
sparfenyuk/mcp-proxy
mcp-proxy is a proxy server tool that enables communication between MCP servers using stdio and SSE transport protocols, facilitating interoperability within the MCP ecosystem.
metatool-ai/metamcp
MetaMCP is a proxy server that aggregates multiple MCP servers into a unified MCP server endpoint, applies middleware, and hosts these endpoints for seamless integration with MCP clients.
samanhappy/mcphub
MCPHub is a unified management platform that aggregates multiple Model Context Protocol (MCP) servers into streamable HTTP endpoints, providing centralized control, real-time monitoring, secure access, and intelligent tool discovery for efficient AI tool integration.
mcp-ecosystem/mcp-gateway
MCP Gateway is a lightweight, configuration-driven gateway service that converts existing APIs into MCP protocol-compliant endpoints without code changes, supporting Docker and Kubernetes deployments with a built-in management UI.
mcpjungle/MCPJungle
MCPJungle is a self-hosted MCP server registry and gateway that centralizes the management and discovery of MCP servers and tools for AI agents and organizations.