Airflow
ActiveDescription
Apache's workflow orchestration platform, the industry-standard ETL solution.
Key Features
- DAG model — Explicit dependencies
- Rich operators — 200+ built-in
- Extensible — Custom operators are easy
- K8s integration — Native KubernetesExecutor
- Visual — Task state at a glance
Use Cases
💡 Enterprise ETL orchestration for data teams.
💡 Schedule and dependency management for LLM workflows.
💡 Model training and release pipelines for ML.
Tags
Categories
Quick Start
# Install
pip install apache-airflow
# Init DB
airflow db init
# Start webserver and scheduler
airflow webserver -p 8080 &
airflow scheduler