Skip to content

Deploy on GCP Composer Airflow (GONRG-888)

Yan Sushchynski (EPAM) requested to merge Witsml_parser_plugable_structure into master

Main changes:

  1. Cloud Composer can't properly process file with code in the plugins folder if these files are big, as it is in our case. So the libs folder was moved into the dags folder. If we don't want Airflow to search DAGs in the libs folder, we must add the .airflowignore into energistics/dags with specifying files we want to ignore.
  2. Add an extra steps to make File part of Manifests follow R2 schema in
  3. Some minor bug fixes in
Edited by Yan Sushchynski (EPAM)

Merge request reports