Ariflow 2.0 Performance Improvements
Topic:: Airflow 2.0 Performance Improvements
Tasks
-
Airflow to support 10000 parallel DAG runs at any point in time -
Airflow autoscaling shouldn't disrupt running workflows as part of scale in. -
Airflow to support 8M queuing capacity -
Documentation with necessary configuration to run above mentioned performance