LangKit
StaleDescription
An open-source toolkit for monitoring Large Language Models, extracting signals from prompts and responses for quality and safety evaluation.
Related Projects
SwanLab
4.0k · Python
An open-source, modern-design AI training tracking and visualization tool. Supports PyTorch, Transformers and more. Monitor and evaluate AI agent training processes.
pythonobservabilityevaluation +2
OpenInference
1.0k · Python
OpenTelemetry instrumentation for AI observability, providing standardized tracing, metrics collection, and span definitions for LLM inference processes to help developers monitor and debug AI agent systems.
observabilitypythonllm +2
Purple Llama
4.2k · Python
Meta's set of tools to assess and improve LLM security, including safety benchmarks, prompt injection detection, and output auditing to help evaluate and enhance the safety of large language models.
securityevaluationpython +2
Prompt Ops
816 · Python
An open-source tool from Meta for LLM prompt optimization. Automates the process of continuously improving and refining LLM prompts.
prompt-engineeringllmtools +2