Flyte

Active
GitHub Go Apache-2.0

Description

Dynamic, resilient AI orchestration platform. Coordinate data, models, and compute as you build AI workflows with scalable ML pipeline and production-grade workload management.

Key Features

  • Pure Python declarative orchestration — define workflows with @task decorators, no YAML or DSL needed
  • Elastic scaling and fault tolerance — auto-retry, timeout management, distributed parallel execution
  • Model serving built-in — FastAPIAppEnvironment deploys REST APIs with one line of code
  • Local dev experience — TUI dashboard monitors task status in real time, browser demo available
  • Containerized workloads — Debian/Python base images with pip dependencies declared in task environment
  • LF AI & Data graduated project — production-grade open-source orchestration with active community

Use Cases

💡 Build reproducible ML training pipelines with automated data preprocessing, feature engineering, and model training
💡 Deploy and orchestrate multiple AI agents to collaboratively execute complex tasks
💡 Package trained models as REST API services with elastic scaling
💡 Share and reuse standardized AI workflow templates across teams
💡 Uniformly schedule large-scale batch inference and ETL jobs on Kubernetes

Categories

Quick Start

Install with pip install flyte, define tasks with @env.task decorator, initialize with flyte.init(), and submit with flyte.run(). Supports flyte CLI for command-line execution, or install TUI via uv pip install flyte[tui] for a local development dashboard.

Related Projects