Apache DolphinScheduler
ActiveDescription
Apache DolphinScheduler is a big-data and AI workflow scheduling platform using DAGs to define task dependencies, widely used for AI agent multi-step execution.
Key Features
- DAG scheduling — visually build task-dependency graphs
- Multi-task — Shell, Python, SQL, Spark, Flink, K8s
- High availability — decentralized Master/Worker architecture
- Permission management — fine-grained users, roles and resources
- Alerting — multi-channel notifications on task failure
- Horizontally scalable — supports massive concurrent tasks
Use Cases
💡 Building enterprise data and AI workflow scheduling
💡 Providing visual task orchestration and monitoring for teams
💡 Hosting always-on AI/ML training and inference jobs
💡 Running observable DAG pipelines across multi-cloud / multi-DC
Strengths & Limitations
✅ Strengths
- • Actively maintained, recent updates
- • High community interest (14.4k stars)
- • Permissive open-source license (Apache-2.0)
- • Responsive to issues, low backlog
Tags
Categories
Quick Start
docker run -d --name dolphinscheduler \
-p 12345:12345 \
apache/dolphinscheduler-standalone-server