LiteLLM
ActiveDescription
LiteLLM provides a unified interface and proxy gateway for LLM calls, simplifying multi-model switching, routing, and cost control.
Related Projects
Helicone
5.6k · TypeScript
Helicone is an open-source proxy and observability platform for LLM applications, offering request tracing, caching, and cost analytics.
observabilityproxyanalytics +1
Orbit
264 · Python
Self-hosted, open-source AI gateway providing one API for 20+ LLM providers, databases, and files with integrated RAG, voice, and guardrails.
gatewayllmrag +2
vLLM
79.7k · Python
A high-throughput and memory-efficient inference and serving engine for LLMs, featuring PagedAttention, continuous batching, and optimized KV cache management for production deployments.
llmpythonframework +2
Astronomer Agents
361 · Python
AI agent tooling for data engineering workflows, providing intelligent agent-assisted capabilities for data processing pipelines.
data-engineeringagent-toolsworkflow +1