Higress
ActiveDescription
Higress is a cloud-native AI-native API gateway with native LLM proxy, function calling and plugin extensions.
Key Features
- AI Gateway — unified LLM proxy with function calling
- Envoy + WASM — high performance with plugin extensibility
- Multi-protocol — HTTP/1, HTTP/2, gRPC, WebSocket
- Plugin ecosystem — auth, rate-limit, cache, transforms
- Cloud-native — built on Istio + Envoy data plane
- Open-source — Alibaba-maintained, enterprise-grade
Use Cases
💡 Proxying multiple LLM providers with unified auth
💡 Unifying function-calling protocol and rate limits
💡 Exposing internal AI services behind a single gateway
💡 Custom WASM plugins to transform LLM output
Categories
Quick Start
helm repo add higress https://higress.io/helm
helm install higress higress/higress -n higress-system --create-namespace
# 安装 Higress Console (可选)
kubectl get svc -n higress-system # 检查 svc