ADR: Add DAG Bootstrap
I believe, that we should start following the common approach of bootstrapping DAGs in this project. For this purpose we need to add placeholders to the DAG in order to replace them with each CSP's values within bootstrap_dag
step.
This was implemented for other DAGs (Segy->Zgy, CSV)
Now CSP's values are specified in the yaml
-file, which is parsed as a dictionary and passed as **kwargs
into KubernetesPodOperator.
(https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics-osdu-integration/-/blob/master/devops/osdu-gcp/airflow_configs.yaml)
MR with adding Bootstrap for GCP: https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics-osdu-integration/-/merge_requests/47