RagaAI Catalyst
NormalDescription
RagaAI Catalyst is an observability, monitoring, and evaluation framework for Agent AI, supporting agent/LLM/tool tracing, multi-agent debugging, and self-hosted dashboard analytics.
Related Projects
LangSmith
851 · Python
LangSmith SDK is LangChain's observability toolkit for LLM apps and agents, covering tracing, evaluation, dataset management, and debugging for production workflows.
observabilitytracingevaluation +1
OpenInference
924 · Python
OpenTelemetry instrumentation for AI observability, providing standardized tracing, metrics collection, and span definitions for LLM inference processes to help developers monitor and debug AI agent systems.
observabilitypythonllm +2
Opik
18.9k · Python
Opik is an open-source LLM observability platform providing agent tracing, evaluation testing, and prompt experiment management to help developers monitor and optimize AI agent systems.
observabilityllm-evaluationtracing +2
Evidently
7.4k · Jupyter Notebook
Evidently is an open-source ML and LLM observability framework with 100+ metrics for evaluating, testing, and monitoring any AI-powered system or data pipeline.
observabilityevaluationmonitoring +2