DeepEval

Ragas is a framework for evaluating RAG (Retrieval Augmented Generation) systems. It provides various evaluation metrics including faithfulness, answer relevance, context precision, helping developers optimize RAG application performance.

TruLens is an open-source tool for evaluating and tracking LLM apps. It provides specialized evaluation for RAG applications including context relevance, groundedness, and answer relevance.

Helicone is an open-source proxy and observability platform for LLM applications, offering request tracing, caching, and cost analytics.

GPT Engineer is an AI tool that generates entire codebases based on natural language descriptions. Just describe what you want to build, the AI asks for clarification, and then builds it.