Airflow run died unexpectedly before EDS Naturalization
Impacted environment:
- EPAM CI environment (Airflow version = 2.9.3)
- GC preship (Airflow version = 2.10.2+composer)
- Azure Preship = to be identify
- AWS Preship = to be identify
Background
When running the EDS Naturalization that contains parallel jobs Naturalization_0
, Naturalization_1
, Naturalization_2
, Naturalization_3
, the airflow environment will be unstable and unable to start the EDS Naturalization process.
EDS Naturalization is working fine as shown in the Run id: 111fecbc-7449-4ca2-ad26-5061c73b8de1
below that contains osdu-airflow-lib==0.28.3
(deployed) in CI environment
Edited by Teo Sheng Pu