Evidently
活跃简介
Evidently 是一个开源 ML 和 LLM 可观测性框架，提供 100+ 评估指标，用于测试、监控和评估 AI 驱动的系统。
相关项目
AgentOps
5.5k · Python
AgentOps 是一个 AI Agent 可观测性平台，提供 Agent 监控、调试和评估功能，帮助开发者优化 Agent 性能。
observabilitymonitoringdebugging +1
OpenInference
924 · Python
OpenTelemetry instrumentation for AI observability, providing standardized tracing, metrics collection, and span definitions for LLM inference processes to help developers monitor and debug AI agent systems.
observabilitypythonllm +2
LangSmith
851 · Python
LangSmith SDK 是 LangChain 团队提供的 LLM 应用与 Agent 可观测性工具链，支持 tracing、评测、数据集管理与调试，适合对生产级 Agent 工作流进行分析和优化。
observabilitytracingevaluation +1
Purple Llama
4.1k · Python
Meta's set of tools to assess and improve LLM security, including safety benchmarks, prompt injection detection, and output auditing to help evaluate and enhance the safety of large language models.
securityevaluationpython +2