PrompToMatix

An open-source tool from Meta for LLM prompt optimization. Automates the process of continuously improving and refining LLM prompts.

A task-aware agent-driven prompt optimization framework from Microsoft Research that iteratively refines prompts for better LLM performance.

Argilla is a collaboration platform for AI engineers and domain experts to build high-quality datasets, collect human feedback, and evaluate models.

OpenTelemetry instrumentation for AI observability, providing standardized tracing, metrics collection, and span definitions for LLM inference processes to help developers monitor and debug AI agent systems.