Merge requests · Open Subsurface Data Universe Software / Platform / Data Flow / Data Ingestion / Ingestion DAGs

Ingestion DAG pipeline updated to deploy for both Airflow 1.10.* & 2.0 environments [GONRG-2869]

!70 · created Aug 19, 2021 by Armen Gasparyan (EPAM) GCP
- MERGED
- Approved
- 3
- 12
updated Aug 24, 2021
GONRG-3943: added error catch for no config change 2 of 6 tasks completed

!89 · created Dec 09, 2021 by Danylo Vanin (EPAM) BUG
- MERGED
- 1
- 0
updated Dec 28, 2021
Enable Support for Packaged DAGs 1 of 6 tasks completed

!67 · created Aug 12, 2021 by harshit aggarwal M8 - Release 0.11 Common Code
- MERGED
- +2
- Approved
- 1
- 5
updated Aug 26, 2021
Included EDS Dataset pattern check 5 of 5 tasks completed

!60 · created Jul 06, 2021 by Rajesh Bollineni
- MERGED
- Approved
- 1
- 1
updated Jul 09, 2021
GONRG-2327: Added possibility to specify custom SA-file for credentials logic 2 of 6 tasks completed

!58 · created Jun 24, 2021 by Siarhei Khaletski (EPAM) M7 - Release 0.10 GCP
- MERGED
- 1
- 0
updated Jun 24, 2021
GONRG-2185: Single manifest validation hidden under the flag 1 of 6 tasks completed

!37 · created Apr 09, 2021 by Siarhei Khaletski (EPAM) Common Code GCP
- MERGED
- Approved
- 1
- 0
updated Apr 13, 2021
GONRG-1749 add manual button in pipeline for stage: deploy 2 of 6 tasks completed

!21 · created Feb 22, 2021 by Mykola Zamkovyi (EPAM)
- MERGED
- Approved
- 1
- 5
updated Feb 22, 2021
Azure - Add zip file

!95 · created Jan 20, 2022 by harshit aggarwal
- MERGED
- 4
updated Jan 20, 2022
GONRG-4004: Replace bootstrap values with AF vars 2 of 6 tasks completed

!94 · created Jan 18, 2022 by Yan Sushchynski (EPAM) M11 - Release 0.14 GCP
updated Jan 21, 2022
Delete osdu-ingest-r2.py 1 of 6 tasks completed

!93 · created Jan 13, 2022 by Yan Sushchynski (EPAM) Common Code GCP
- MERGED
- Approved
- 0
updated Jan 18, 2022
[GONRG-4086] Use PyPi package version from master 2 of 5 tasks completed

!92 · created Jan 10, 2022 by Danylo Vanin (EPAM) GCP
- MERGED
- 0
updated Jan 11, 2022
GONRG-4002: Increase DAG timeout to process large Manifests 1 of 6 tasks completed

!91 · created Dec 15, 2021 by Yan Sushchynski (EPAM) Common Code GCP
- MERGED
- Approved
- 0
updated Dec 15, 2021
GONRG-3893-bootstrap: added new variables: sa_file_path, data_partition,... 2 of 7 tasks completed

!90 · created Dec 09, 2021 by Aliaksandr Lubouski (EPAM) GCP
- MERGED
- 1
updated Dec 10, 2021
GONRG-3779: Common pipeline for dag 2 of 6 tasks completed

!88 · created Nov 23, 2021 by Yan Sushchynski (EPAM) M10 - Release 0.13 GCP
- MERGED
- Approved
- 0
updated Dec 22, 2021
GONRG-3675-bootstrap: added pipeline, Dockerfile, as well as configuration... 2 of 7 tasks completed

!87 · created Nov 16, 2021 by Aliaksandr Lubouski (EPAM) GCP
- MERGED
- 0
updated Nov 20, 2021
Remove unused dags

!86 · created Nov 15, 2021 by harshit aggarwal azure/OSDU-Manifest-Ingestion-Dags-M8-Master
- MERGED
- Approved
- 0
updated Nov 15, 2021
GONRG-3733 remove airflow v1 deployment steps 2 of 6 tasks completed

!85 · created Nov 11, 2021 by Aleksandr Spivakov (EPAM) M10 - Release 0.13 GCP
- MERGED
- Approved
- 0
updated Nov 11, 2021
GONRG-3709 fix E2E tests 2 of 6 tasks completed

!84 · created Oct 28, 2021 by Aleksandr Spivakov (EPAM) M10 - Release 0.13 GCP
- MERGED
- Approved
- 0
updated Nov 03, 2021
Merge branch 'GONRG-3605_Update_dags_deps_for_release' into 'master' 1 of 6 tasks completed

!83 · created Oct 27, 2021 by Siarhei Khaletski (EPAM) M9 - Release 0.12 release/0.12
- MERGED
- 0
updated Oct 27, 2021
GONRG-3605: Update deps version to 0.12.0 1 of 6 tasks completed

!82 · created Oct 26, 2021 by Yan Sushchynski (EPAM) M9 - Release 0.12 Common Code GCP
- MERGED
- Approved
- 0
updated Oct 27, 2021