Haystack

Active
GitHub Python Apache-2.0

Description

Haystack is an enterprise-grade framework for RAG and search applications, covering document processing, retrieval, generation, and evaluation end to end.

Key Features

  • Modular pipeline architecture — compose retrieval, routing, memory, and generation components as DAGs with conditional branches and loops
  • Model and vendor agnostic — swap OpenAI, Anthropic, Cohere, Hugging Face, AWS Bedrock, and local models without rewriting
  • Context engineering control — explicit control over how information is retrieved, ranked, filtered, combined, and routed before reaching the model
  • Extensible component ecosystem — build and share custom components through a consistent interface for community and third-party extensions
  • Built-in evaluation and observability — end-to-end evaluation pipelines to test and measure RAG output quality
  • Production-ready deployment — Docker containerization support with enterprise-grade Haystack Enterprise platform

Use Cases

💡 Enterprise knowledge base RAG: connect internal document stores with multi-turn conversational Q&A
💡 Semantic search engine: build vector-embedding-based semantic retrieval systems as alternatives to keyword search
💡 Multimodal Q&A systems: combine text and image retrieval for cross-modal document question answering
💡 Autonomous agent workflows: use agent components to call external tools and execute multi-step reasoning tasks
💡 Document classification and information extraction: apply pipeline components to extract structured information from unstructured documents

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (26.2k stars)
  • Permissive open-source license (Apache-2.0)
  • Responsive to issues, low backlog

Quick Start

```bash
pip install haystack-ai
```

Related Projects

Unstract

7.1k · Python
Active A+

LLM-driven extraction of unstructured data, built for API deployments and ETL pipeline workflows. Automates document parsing, PDF extraction, and intelligent data processing with LLM-powered intelligence.

data-processingragpython +3
  • · Prompt Studio defines document extraction schemas with natural language
  • · Supports REST API deployment and ETL pipeline workflows
  • · MCP Server integration connecting to Claude and other AI agents

DocETL

4.0k · Python
Active A+

An agentic LLM-powered data processing and ETL system. Enables complex data transformations using natural language-defined pipelines, turning unstructured data into structured, analyzable outputs with LLM intelligence.

data-processingragpython +3
  • · LLM-powered data processing pipeline engine with operators like map, reduce, resolve, gleaning, and filter for complex document transformations
  • · DocWrangler interactive UI playground for iterative prompt engineering — experiment with prompts and see results in real-time
  • · Python package for production pipelines runnable from command line or Python code with full programmatic control

LightRAG

38.9k · Python
Active A+

LightRAG is a simple and fast Retrieval-Augmented Generation framework using graph-enhanced retrieval, published at EMNLP 2025.

raggraphretrieval +2
  • · Graph-enhanced retrieval — Dual-level retrieval (local/global) using knowledge graph entities and relationships, more precise than vector search
  • · Four text chunking strategies — Fixed, Recursive, Vector, and Paragraph chunking adapted to different document types
  • · Multi-backend storage — Neo4j, PostgreSQL, MongoDB, OpenSearch, JSON KV Store and other storage backends supported

OpenLLM

12.5k · Python
Active A+

Run any open-source LLMs such as DeepSeek and Llama as OpenAI-compatible API endpoints in the cloud. Supports fine-tuning, quantization, and distributed inference for production-grade LLM deployment.

llmpythonapi +3
  • · Any Open-Source LLM Support: Run DeepSeek, Llama, Qwen and any open-source models
  • · OpenAI-Compatible APIs: Provides endpoints compatible with OpenAI API for seamless integration
  • · Built-in Chat UI: Ready-to-use chat interface

Related Articles