Best RAG Tools Top 20
Top 20 most popular open-source RAG Tools projects, ranked by GitHub Stars.
LangChain
144.4k StarsLangChain is the open-source agent engineering platform that unifies model IO, tool calling, RAG, memory and observability under one composable framework.
Awesome LLM Apps
132.9k Stars100+ AI Agent and RAG apps you can actually run — clone, customize, and ship. A great reference for quickly building LLM-powered applications.
llama.cpp
124.2k Starsllama.cpp is a lightweight C/C++ inference engine that runs a wide range of open-source large language models efficiently on consumer hardware.
Supabase Vector
108.1k StarsSupabase's built-in pgvector search, turning Postgres into a RAG database.
vLLM
89.2k StarsA high-throughput and memory-efficient inference and serving engine for LLMs, featuring PagedAttention, continuous batching, and optimized KV cache management for production deployments.
RAGFlow
88.6k StarsA leading open-source RAG engine that fuses cutting-edge retrieval-augmented generation with agent capabilities to create a superior context layer for LLMs.
MinerU
77.7k StarsTransforms complex documents like PDFs into LLM-ready markdown/JSON for Agentic workflows, supporting layout analysis, formula recognition, and table extraction.
Prompt Engineering Guide
77.5k StarsComprehensive guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
Hello Agents
73.2k StarsA comprehensive tutorial on AI agent principles and practice, systematically covering core concepts, framework usage and hands-on projects.
codegraph
66.6k StarsCodeGraph is a context graph for coding agents, mapping how a codebase is wired together so LLM-driven tools can navigate dependencies and produce more accurate edits.
Docling
64.9k StarsDocling is an open-source document processing tool by IBM that converts PDF, Word, PPT, HTML and more into structured data for AI, purpose-built for GenAI and RAG pipelines.
Embedchain
63.4k StarsEmbedchain is a universal memory layer for AI agents, enabling quick integration of diverse data sources into LLMs for context-aware AI applications.
Mem0
63.4k StarsMem0 is a long-term memory layer for AI agents, supporting cross-session memory management and personalized context retrieval.
Daily Stock Analysis
63.0k StarsLLM-powered stock analysis system for A/H/US markets with multi-source quotes, real-time news, LLM decision dashboard and multi-channel push notifications.
Pathway
62.5k StarsPathway is a Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG applications.
TrendRadar
61.5k StarsAI-driven public opinion and trend monitor with multi-platform aggregation, RSS subscriptions, smart keyword filtering, AI-powered news analysis and briefings, supporting MCP integration and push notifications via WeChat, Feishu, DingTalk, Telegram and more.
Context7
60.8k StarsContext7 is Upstash's context-engineering toolkit for agents, helping applications manage long context windows, retrieval injection, and history compression.
Pathway LLM App
59.0k StarsReady-to-run cloud templates for RAG, AI pipelines and enterprise search with live data, always in sync with Sharepoint, Google Drive, S3, Kafka and more.
Meilisearch
59.0k StarsMeilisearch is a lightweight open-source search engine with typo tolerance, native vector search and instant indexing, commonly used as the retrieval layer for agents and RAG.
Private GPT
57.4k StarsPrivateGPT is a fully-local AI application API layer with RAG, agents and multi-model routing, providing zero-data-leak private deployment.
Related Articles
Agent Memory Architecture: Working, Long-term, and Shared Memory Trade-offs
A systematic comparison of the three categories of agent memory -- working, long-term, and shared -- covering storage media, lifecycle, retrieval methods, typical frameworks, and design patterns, fully addressing agent personalization and multi-agent collaboration engineering.
Designing Agent Memory Systems: From Short-Term Context to Persistent Knowledge
A deep dive into the four-layer agent memory architecture, with practical code for vector retrieval and memory compression to help you build scalable long-term memory systems.
Agent Rate Limiting and Cost Attack Defense: Token Quotas, Sliding Windows, Attack Vector Practice
Systematic guide to rate limiting and cost attack defense for LLM Agents in production: single-user token quotas, multi-tenant sliding windows, prompt injection amplifying cost, DDoS protection, and integration with LangChain/CrewAI/AutoGen frameworks.