PageIndex

Active
GitHub Python MIT

Description

Open-source vectorless, reasoning-based RAG that builds a hierarchical tree index from long documents and uses LLMs to reason over it, achieving 98.7% on FinanceBench without vector DBs or chunking.

Key Features

  • Vectorless retrieval — no vector DB or chunking needed; uses document structure and LLM reasoning
  • Hierarchical tree index — automatically generates TOC-style tree structure from long documents
  • Reasoning-driven — every retrieval result is traceable to explicit page and section references
  • Context-aware — retrieval depends on full conversation context and incorporates new information dynamically
  • Tree-search algorithm — LLM performs multi-step reasoning over the index tree to find relevant sections
  • High accuracy — achieves 98.7% on FinanceBench, vastly outperforming vector-based RAG

Use Cases

💡 High-accuracy Q&A on long financial reports, regulatory filings, and academic textbooks
💡 Building explainable RAG systems where every retrieval result is traceable to the source page
💡 Replacing traditional vector retrieval to avoid similar-but-irrelevant false positives
💡 Powering enterprise knowledge bases that require multi-step reasoning over professional documents
💡 Providing Agentic tool-calling for LLMs to complete document analysis tasks

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (35.2k stars)
  • Permissive open-source license (MIT)
  • Responsive to issues, low backlog

Categories

Quick Start

git clone https://github.com/VectifyAI/PageIndex.git
cd PageIndex
pip install -r requirements.txt
export OPENAI_API_KEY=sk-...
python examples/agentic_vectorless_rag_demo.py

Related Projects

KAG

9.0k · Python
Stale B

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs for building logical reasoning and factual Q&A solutions for professional domain knowledge bases, effectively overcoming the limitations of traditional RAG vector similarity models.

knowledge-graphragreasoning +2
  • · Bidirectional knowledge-text indexing: KG nodes cross-reference original text chunks for complete context preservation
  • · Logic form-guided hybrid reasoning: transforms natural language into formal logical inference combining exact match, text retrieval, numerical computation, and semantic reasoning
  • · Schema-constrained knowledge construction: supports both free-form information extraction and structured domain expert knowledge representation

FlagEmbedding

12.1k · Python
Active A

Open-source BGE series embedding models and retrieval tools from BAAI, providing state-of-the-art text embeddings and rerankers for Chinese and English, widely used in RAG systems and agent retrieval pipelines.

embeddingsbgeretrieval +3
  • · State-of-the-art multilingual embeddings (BGE-M3) supporting 100+ languages with dense, lexical, and multi-vector retrieval
  • · BGE-VL multimodal embeddings for text-to-image, image-to-text, and cross-modal visual search
  • · Lightweight rerankers with token compression and layerwise operations for efficient resource usage

LightRAG

38.9k · Python
Active A+

LightRAG is a simple and fast Retrieval-Augmented Generation framework using graph-enhanced retrieval, published at EMNLP 2025.

raggraphretrieval +2
  • · Graph-enhanced retrieval — Dual-level retrieval (local/global) using knowledge graph entities and relationships, more precise than vector search
  • · Four text chunking strategies — Fixed, Recursive, Vector, and Paragraph chunking adapted to different document types
  • · Multi-backend storage — Neo4j, PostgreSQL, MongoDB, OpenSearch, JSON KV Store and other storage backends supported

RAG Techniques

29.1k · Jupyter Notebook
Active A+

NirDiamant's RAG_Techniques repository systematically collects and demonstrates cutting-edge retrieval-augmented generation techniques and engineering practices.

ragretrievaltechniques +2
  • · Systematic taxonomy — techniques organised by simple / advanced / modular levels for targeted learning
  • · Runnable notebooks — every technique ships with a Jupyter notebook and minimal runnable code
  • · Evaluation & comparison — retrieval quality and answer quality evaluation scripts with visualisation