Upcoming Change to GitLab Pages The GitLab Pages URL is planned to migrate from the current *.pages.community.opengroup.org to a simpler domain: *.pages.opengroup.org. At the same time, HTTPS will be enabled for the server. This change is planned for May 21, 2022.

If you have questions or concerns, please email forum-support@opengroup.org.

ADR: Add DAG Bootstrap

I believe, that we should start following the common approach of bootstrapping DAGs in this project. For this purpose we need to add placeholders to the DAG in order to replace them with each CSP's values within bootstrap_dag step.

This was implemented for other DAGs (Segy->Zgy, CSV)

Now CSP's values are specified in the yaml-file, which is parsed as a dictionary and passed as **kwargs into KubernetesPodOperator. (https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics-osdu-integration/-/blob/master/devops/osdu-gcp/airflow_configs.yaml)

MR with adding Bootstrap for GCP: !47 (merged)

Edited Feb 07, 2022 by Kateryna Kurach (EPAM)