Prefect

Pythonic workflow orchestration for modern data and ML pipelines.

Prefect is an open-source workflow orchestration framework for building, scheduling, and monitoring data and machine-learning pipelines in pure Python. Flows and tasks are defined with simple decorators, and the engine adds retries, caching, scheduling, observability, and dynamic, parameterized runs without forcing a rigid DAG structure. It is one of the most popular Python-native alternatives to Airflow.