Dagster
ActiveDescription
An orchestration platform for developing, producing, and observing data assets and AI workflows, with built-in asset definitions, scheduling, and monitoring.
Related Projects
Prefect
22.2k · Python
A workflow orchestration framework for building resilient data pipelines and AI workflows in Python, with task scheduling, state management, and failure recovery from local to distributed deployments.
workflowautomationpython +2
Instill Core
2.3k · Python
A full-stack AI infrastructure tool for data, model, and pipeline orchestration. Streamlines building versatile AI-first applications with a visual pipeline editor for end-to-end workflows from data ingestion to model inference.
workflowpythonautomation +3
Unstract
6.5k · Python
LLM-driven extraction of unstructured data, built for API deployments and ETL pipeline workflows. Automates document parsing, PDF extraction, and intelligent data processing with LLM-powered intelligence.
data-processingragpython +3
Integuru
4.6k · Python
The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs for cross-platform automation.
workflowpythonagent +2