Envoy AI Gateway
ActiveDescription
Envoy AI Gateway is the Envoy community's AI gateway implementation, unifying access to multiple LLM providers.
Key Features
- Envoy data plane — high-performance flexible routing
- Multi-provider — OpenAI, Anthropic and more
- Function calling — unified protocol
- Observability — OpenTelemetry integration
- Rate-limit — tokens, quotas and concurrency
- CNCF sandbox — cloud-native standard
Use Cases
💡 Plugging many LLM providers into Envoy
💡 Rate-limiting and quotas for AI traffic
💡 A unified Kubernetes entry for AI
💡 Reusing Envoy routing for AI
Tags
Categories
Quick Start
kubectl apply -f https://github.com/envoyproxy/ai-gateway/releases/latest/download/install.yaml
# 看 https://aigateway.envoyproxy.io 文档
# 用 kubectl get pods 验证 Gateway 运行