MLflow
ActiveDescription
MLflow is the open-source AI engineering platform for debugging, evaluating, monitoring, and optimizing AI agents and LLM applications, with model and data access management.
Related Projects
Agenta
4.1k · TypeScript
Agenta is an open-source LLMOps platform providing prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
observabilityllmopsprompt-management +2
SwanLab
3.9k · Python
An open-source, modern-design AI training tracking and visualization tool. Supports PyTorch, Transformers and more. Monitor and evaluate AI agent training processes.
pythonobservabilityevaluation +2
OpenInference
965 · Python
OpenTelemetry instrumentation for AI observability, providing standardized tracing, metrics collection, and span definitions for LLM inference processes to help developers monitor and debug AI agent systems.
observabilitypythonllm +2
Evidently
7.5k · Jupyter Notebook
Evidently is an open-source ML and LLM observability framework with 100+ metrics for evaluating, testing, and monitoring any AI-powered system or data pipeline.
observabilityevaluationmonitoring +2