LEANN

Active
GitHub Python MIT

Description

RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device. Published at MLsys 2026.

Key Features

  • 97% storage reduction vs traditional vector databases with no accuracy loss
  • Graph-based selective recomputation — embeddings computed on demand, not stored
  • 100% local and private — data never leaves your laptop
  • Native MCP integration for Claude Code and other AI assistants
  • Handles 60M+ documents in 6GB instead of 201GB on consumer hardware
  • Cross-platform: macOS, Linux, Windows (WSL), with Python 3.9-3.13

Use Cases

💡 Personal RAG over emails, browser history, chat logs, and local files
💡 Semantic search for Claude Code replacing basic grep-style keyword search
💡 Indexing and searching WeChat, iMessage, Slack, and Twitter conversations
💡 Privacy-sensitive document retrieval without cloud dependency
💡 Building personal AI assistants with full local knowledge bases

Categories

Quick Start

curl -LsSf https://astral.sh/uv/install.sh | sh (install uv). git clone https://github.com/yichuan-w/LEANN.git && cd leann. uv venv && source .venv/bin/activate && uv pip install leann. Then follow the example notebooks in the repo.

Related Projects