Incorrect Airflow (AIRFLOW_VAR_xxx) environment variables
The name of some of Airflow environment variables set in values.yaml, such as AIRFLOW_VAR_CORE__SERVICE__DATASET__HOST
, are different from the ones osdu-airflow-lib is looking for (such as core__service__dataset__url
that means the env var set in values.yaml must be named AIRFLOW_VAR_CORE__SERVICE__DATASET__URL
).
I don't know how many of these incorrect env vars are there but making sure both AIRFLOW_VAR_CORE__SERVICE__<some_service>__HOST
and AIRFLOW_VAR_CORE__SERVICE__<some_service>__URL
fixed it for me.