airbyte

Active
GitHub Python NOASSERTION

Description

Airbyte is an open-source ELT data integration platform designed for AI agents and the modern data stack, connecting APIs, databases, and files to warehouses and AI applications.

Key Features

  • 600+ data connectors covering APIs, databases, warehouses, and lakes
  • Designed for AI agents with Airbyte Agents and a dedicated Agent SDK
  • No-code Connector Builder to create custom data sources in minutes
  • Low-code CDK using YAML to define data sync logic
  • Multiple deployment forms: open-source self-hosted, Airbyte Cloud, Enterprise Kubernetes
  • LLM tool integration compatible with pydantic-ai, LangChain, OpenAI Agents, and FastMCP

Use Cases

💡 Connect AI agents to SaaS and enterprise data for real-time CRM, ticket, and database access
💡 Build enterprise ELT pipelines that consolidate distributed data into a warehouse
💡 Use the Agent SDK to wrap connectors as LLM-callable tools
💡 Replicate and sync data across systems with 600+ connectors

Strengths & Limitations

Strengths

  • Actively maintained, recent updates
  • High community interest (21.9k stars)

⚠️ Limitations

  • High issue backlog (2.3k open issues)
  • No clear open-source license

Quick Start

# Install the Agent SDK
uv pip install airbyte-agent-sdk

# Create an LLM tool set
from airbyte_agent_sdk import AirbyteAgent
agent = AirbyteAgent(sources=["hubspot", "postgres"])
tools = agent.as_tools()  # Returns LangChain / pydantic-ai compatible tools

# Use inside an agent
from langchain_openai import ChatOpenAI
llm = ChatOpenAI(model="gpt-4").bind_tools(tools)
llm.invoke("List HubSpot contacts created last week")

Related Projects

Semble

5.9k · Python
Active A+

Fast and accurate code search engine designed for AI agents. Uses semantic indexing instead of grep+read, reducing token consumption by roughly 98% while delivering higher-quality retrieval for code navigation tasks.

code-searchembeddingsmcp +2
  • · Lightning-fast semantic search — embedding-based code retrieval that reduces token usage by ~98% vs grep+read
  • · MCP server — exposes Model Context Protocol endpoints so agents can call it directly
  • · High recall — outperforms traditional text matching on multiple code-retrieval benchmarks

ApeRAG

1.3k · Python
Stale C

ApeRAG is a production-ready GraphRAG system with multi-modal indexing, AI agent integration, MCP support, and scalable Kubernetes deployment, providing a complete solution for enterprise-grade RAG applications.

graphragmulti-modalmcp +2
  • · Production-ready RAG platform with hybrid retrieval combining Graph RAG, vector search, and full-text search
  • · Five index types: vector, full-text, graph, summary, and vision for multi-dimensional document understanding
  • · Built-in AI agents with MCP support for automatic collection identification and intelligent content search

Casibase

5.5k · Go
Active A

An open-source enterprise-level AI knowledge base and MCP management platform with integrated knowledge retrieval, model management, and agent chat for enterprise AI applications.

knowledge-basemcpenterprise +3
  • · Enterprise knowledge base platform with auto-chunking, embedding and indexing for PDF, Word, Excel and more
  • · Multi-tenant architecture with OIDC/OAuth2/LDAP/SAML single sign-on support
  • · Visual workflow builder with conditional branching and parallel execution