Skip to content

Upgrade airflow to version 2.9.2

Stevemunene requested to merge airflow_version_2_9_1 into main

Deploying the newest airflow version to access new features and fix some CVE related issues. The features are: Displaying meaningful names for each dynamic task instance generated in the UI. Currently, it shows only an integer, the index of the dynamic task instance. e.g., for the Refine source sensor, we would get from 0 to sense_ mediawiki_reading_depth

Allowing depth-first execution within a dynamic dag. Instead of waiting for all sensors to pass before beginning to launch all the ETL jobs, we can queue the ETL job as soon as its matching sensor instance is successful.

Bug: T365449

Merge request reports