Skip to content

Airflow run died unexpectedly before EDS Naturalization

Impacted environment:

  • EPAM CI environment (Airflow version = 2.9.3)
  • GC preship (Airflow version = 2.10.2+composer)
  • Azure Preship = to be identify
  • AWS Preship = to be identify

Background

When running the EDS Naturalization that contains parallel jobs Naturalization_0, Naturalization_1, Naturalization_2, Naturalization_3, the airflow environment will be unstable and unable to start the EDS Naturalization process.

EDS Naturalization is working fine as shown in the Run id: 111fecbc-7449-4ca2-ad26-5061c73b8de1 below that contains osdu-airflow-lib==0.28.3 (deployed) in CI environment

Edited by Teo Sheng Pu