OpenInference
活跃简介
OpenTelemetry instrumentation for AI observability, providing standardized tracing, metrics collection, and span definitions for LLM inference processes to help developers monitor and debug AI agent systems.
相关项目
Purple Llama
4.1k · Python
Meta's set of tools to assess and improve LLM security, including safety benchmarks, prompt injection detection, and output auditing to help evaluate and enhance the safety of large language models.
securityevaluationpython +2
Prompt Ops
800 · Python
An open-source tool from Meta for LLM prompt optimization. Automates the process of continuously improving and refining LLM prompts.
prompt-engineeringllmtools +2
Weave
1.1k · Python
Weights & Biases 推出的 AI 应用开发工具包，提供 LLM 调用追踪、评估实验管理和版本化能力，助力 AI 应用从原型到生产的全流程管理。
observabilityevaluationllm +2
HolmesGPT
2.2k · Python
A CNCF Sandbox SRE Agent that automatically analyzes infrastructure logs and metrics to assist with incident diagnosis and system operations.
observabilitypythonagent +2