Airflow run died unexpectedly before EDS Naturalization
Impacted environment:
- EPAM CI environment (Airflow version = 2.9.3)
- GC preship (Airflow version = 2.10.2+composer)
- Azure Preship = to be identify
- AWS Preship = to be identify
Background
When running the EDS Naturalization that contains parallel jobs Naturalization_0, Naturalization_1, Naturalization_2, Naturalization_3, the airflow environment will be unstable and unable to start the EDS Naturalization process.
EDS Naturalization is working fine as shown in the Run id: 111fecbc-7449-4ca2-ad26-5061c73b8de1 below that contains osdu-airflow-lib==0.28.3 (deployed) in CI environment
Edited by Teo Sheng Pu