Kong

Active
GitHub Lua Apache-2.0

Description

The cloud-native API and AI Gateway providing LLM request routing, rate limiting, load balancing and observability for AI agent applications.

Key Features

  • API Traffic Management — Advanced routing, load balancing, health checks via RESTful Admin API or declarative config
  • AI Gateway Capabilities — Universal LLM API routing across OpenAI, Anthropic, Gemini, Bedrock and more
  • MCP Traffic Governance — MCP security, observability, and auto-generation from any RESTful API
  • Authentication and Authorization — JWT, OAuth, basic auth, ACLs and more authentication methods
  • 60+ Plugins — Rate limiting, request transformation, logging, monitoring and rich plugin ecosystem
  • Native K8s Support — Runs natively on Kubernetes via the official Ingress Controller

Use Cases

💡 Provide unified API gateway and traffic entry point for microservice architectures
💡 Implement unified multi-LLM provider access and load balancing in AI applications
💡 Protect MCP and AI service traffic with security and access control
💡 Apply rate limiting, circuit breaking and observability monitoring to API and AI services
💡 Deploy and manage API gateways in Kubernetes environments

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (44.0k stars)
  • Permissive open-source license (Apache-2.0)
  • Responsive to issues, low backlog

Quick Start

# Start Kong with Docker
git clone https://github.com/Kong/docker-kong
cd docker-kong/compose/

# Start the Gateway
docker-compose up -d

# Access Kong Admin API
curl http://localhost:8001/services

# Open Kong Manager UI
open http://localhost:8002

Related Projects

Agents Towards Production

21.3k · Jupyter Notebook
Active A+

End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.

agentframeworkevaluation +2
  • · 28 production-grade tutorials — Covering stateful workflows, vector memory, web search APIs and more
  • · End-to-end coverage — From Docker deployment, FastAPI endpoints to security guardrails and GPU scaling
  • · Multi-agent coordination — Teaching multi-Agent collaboration architecture design and implementation

Entire CLI

4.9k · Go
Active A

CLI that hooks into your Git workflow to capture AI agent sessions as you work — sessions are indexed alongside commits, creating a searchable record of how code was written in your repo.

gocodingagent +2
  • · Git-native integration that automatically captures AI agent sessions tied to commits
  • · Session replay: rewind to any historical agent checkpoint and resume work
  • · Full context preserved: prompts, responses, file changes, token usage all searchable