Skip to content

Deploy on GCP Composer Airflow (GONRG-888)

Yan Sushchynski (EPAM) requested to merge Witsml_parser_plugable_structure into master

Main changes:

  1. Cloud Composer can't properly process file with code in the plugins folder if these files are big, as it is in our case. So the libs folder was moved into the dags folder. If we don't want Airflow to search DAGs in the libs folder, we must add the .airflowignore into energistics/dags with specifying files we want to ignore.
  2. Add an extra steps to make File part of Manifests follow R2 schema in process_energistics_op.py.
  3. Some minor bug fixes in process_energistics_op.py.
Edited by Yan Sushchynski (EPAM)

Merge request reports