LiteLLM

Helicone is an open-source proxy and observability platform for LLM applications, offering request tracing, caching, and cost analytics.

GPT Engineer is an AI tool that generates entire codebases based on natural language descriptions. Just describe what you want to build, the AI asks for clarification, and then builds it.

DeepEval is an open-source evaluation framework for LLM applications. It provides rich evaluation metrics and tools, supporting unit testing and integration testing to help developers build reliable LLM applications.

Continue is an open-source AI code assistant extension for VS Code and JetBrains IDE. It can autocomplete code, refactor, and explain code, helping developers improve programming efficiency.