WebArena is a realistic benchmark environment for evaluating autonomous web agents. It provides Gym-like interactive website simulations covering e-commerce, forums, CMS, and more, enabling end-to-end task evaluation as a standard framework for web agent research.
LaVague is a Large Action Model (LAM) framework for developing AI web agents, combining RAG techniques for natural-language-driven browser automation.
Notte is a framework for building web agents and deploying serverless browser automation functions, providing reliable browser infrastructure and web-aware agent capabilities.
The first open-source testing agent that enables UI, API, security, accessibility, and visual validations without writing code or maintaining tests
MTEB (Massive Text Embedding Benchmark) is a comprehensive benchmark framework for evaluating text embeddings across classification, retrieval, clustering, reranking, and more, helping select optimal embedding models for RAG systems.