HolmesGPT

The cloud-native API and AI Gateway providing LLM request routing, rate limiting, load balancing and observability for AI agent applications.

End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.

OpenTelemetry instrumentation for AI observability, providing standardized tracing, metrics collection, and span definitions for LLM inference processes to help developers monitor and debug AI agent systems.

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?