Embedchain

Active
GitHub Python Apache-2.0

Description

Embedchain is a universal memory layer for AI agents, enabling quick integration of diverse data sources into LLMs for context-aware AI applications.

Key Features

  • Universal memory layer — quickly integrates diverse data sources (web, PDFs, YouTube, Notion) into LLMs for context
  • Vectorized storage — auto-chunks, embeds, and stores data in vector databases with semantic retrieval support
  • Multi-LLM backend support — compatible with OpenAI, Cohere, Ollama and other LLM and embedding models
  • Simple API — three lines of code to complete data loading, indexing, and querying end-to-end
  • Multi-database adapters — supports Chroma, Pinecone, Qdrant, Weaviate and other mainstream vector databases
  • Streaming responses — supports streaming LLM output for improved user experience

Use Cases

💡 Rapid RAG application: connect document collections to LLMs to build private Q&A systems in minutes
💡 Personal knowledge assistant: integrate Notion, web bookmarks, and PDF notes into a conversational knowledge tool
💡 Customer service knowledge: load product docs and FAQs as vector indexes for agent-based precise answer retrieval
💡 Code documentation Q&A: index project docs and API references for natural language technical documentation queries
💡 Multi-source information aggregation: extract info from web, video subtitles, and local files into unified semantic indexes

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (63.4k stars)
  • Permissive open-source license (Apache-2.0)
  • Established track record (3 years in production)

Quick Start

# Install Embedchain
pip install embedchain

# Quick start: 3 steps to build a RAG app
from embedchain import App

# Create app and load data
app = App.from_config(config={
    "llm": {"provider": "openai", "config": {"model": "gpt-4o-mini"}},
    "vectordb": {"provider": "chroma"}
})

app.add("https://www.example.com/docs")  # Load web data
answer = app.query("What is the main content of this document?")  # Query
print(answer)

Related Projects

MemAgent

1.1k · Python
Stale B

A MemAgent framework that can extrapolate to 3.5M context tokens, along with a training framework for RL training of any agent workflow.

memoryagentrag +2
  • · Ultra-Long Context Processing: Extrapolate from 8K training context to 3.5M tokens with performance loss under 5%
  • · Reinforcement Learning Driven: Trained with RLVR (Reinforcement Learning from Verifiable Rewards), extends DAPO algorithm for end-to-end multi-turn conversation optimization
  • · Linear Time Complexity: Breaks through computational bottlenecks in long-text processing with linear resource scaling

HyperDB

1.4k · Python
Stale C

A hyper-fast local vector database for use with LLM Agents, providing lightweight vector storage and similarity search capabilities for embedding as instant memory and knowledge retrieval components in agent applications.

vector-databasepythonagent +2
  • · Hyper-fast local vector database designed specifically for LLM Agents
  • · C++ high-performance backend with hardware-accelerated operations via MKL BLAS
  • · Simple unified interface compatible with all major LLM agent frameworks

MemVid

16.2k · Rust
Normal A

MemVid is a long-term memory layer for AI agents that uses video encoding for lightweight single-file storage, replacing complex RAG pipelines with instant retrieval.

memoryragvector-database +2
  • · Single-file portable memory layer — no database or server infrastructure required
  • · Smart Frame architecture inspired by video encoding for append-only, crash-safe storage
  • · Sub-5ms retrieval latency at scale with predictive caching (0.025ms P50)

TrustGraph

2.5k · Python
Active A+

A graph-native context development platform for storing, enriching, and retrieving structured knowledge with semantic search and portable context cores, supporting RDF, SPARQL, and other standards for AI agent knowledge management.

ragmemorydatabase +3
  • · Context Graph engine with automated entity/relationship extraction and ontology-driven graph construction
  • · Out-of-the-box RAG pipelines: DocumentRAG, GraphRAG, and OntologyRAG
  • · Multi-model database system supporting tabular, document, graph, vector, image, video, and audio data