RouteLLM
StaleDescription
RouteLLM is a framework for serving and evaluating LLM routers, enabling cost reduction without compromising quality through intelligent request routing across multiple model tiers.
Related Projects
AgentLabs
546 · TypeScript
AgentLabs is a toolkit for agent development and testing, focused on experimentation, replay, and workflow support to improve iteration speed.
testingdeveloper-toolsevaluation +1
DeepEval
14.8k · Python
DeepEval is an open-source evaluation framework for LLM applications. It provides rich evaluation metrics and tools, supporting unit testing and integration testing to help developers build reliable LLM applications.
llmevaluationtesting +1
Harbor
1.5k · Python
Framework for running agent evaluations and creating RL environments to measure and improve agent performance
evaluationbenchmarkrl-environments +2
Plano
6.3k · Rust
An AI-native proxy and data plane for agentic apps with built-in orchestration, safety, observability, and smart LLM routing so developers can focus on agent core logic.
llm-gatewayllm-routingobservability +2