Merge requests · Open Subsurface Data Universe Software / Platform / Data Flow / Data Ingestion / Ingestion DAGs

Ingestion DAG pipeline updated to deploy for both Airflow 1.10.* & 2.0 environments [GONRG-2869]

!70 · created Aug 19, 2021 by Armen Gasparyan (EPAM) GCP
- MERGED
- Approved
- 3
- 12
updated Aug 24, 2021
Azure - Add Test Stage ADO pipeline

!69 · created Aug 18, 2021 by harshit aggarwal
- MERGED
- Approved
- 0
updated Aug 19, 2021
Azure - Adding E2E Test Stage 2 of 6 tasks completed

!68 · created Aug 17, 2021 by harshit aggarwal
- MERGED
- Approved
- 5
updated Aug 19, 2021
Enable Support for Packaged DAGs 1 of 6 tasks completed

!67 · created Aug 12, 2021 by harshit aggarwal M8 - Release 0.11 Common Code
- MERGED
- +2
- Approved
- 1
- 5
updated Aug 26, 2021
GONRG-2696: Manifest integrity batch search 2 of 6 tasks completed

!66 · created Aug 10, 2021 by Yan Sushchynski (EPAM) M8 - Release 0.11 Common Code GCP
- MERGED
- Approved
- 0
updated Aug 23, 2021
Azure - Updating ADO pipeline

!65 · created Aug 10, 2021 by harshit aggarwal
- MERGED
- Approved
- 2
updated Aug 10, 2021
GONRG-2913: Added support for whitelist reference patterns to exclude from... 1 of 6 tasks completed

!64 · created Aug 09, 2021 by Aleksandr Spivakov (EPAM) M8 - Release 0.11 GCP
- MERGED
- Approved
- 6
updated Sep 06, 2021
Azure - Adding Gitlab pipelines 2 of 6 tasks completed

!63 · created Aug 04, 2021 by harshit aggarwal
- MERGED
- Approved
- 2
updated Aug 09, 2021
GONRG-2726: Move libs to SDK 1 of 6 tasks completed

!62 · created Jul 14, 2021 by Yan Sushchynski (EPAM) M7 - Release 0.10 GCP
- MERGED
- Approved
- 0
updated Jul 20, 2021
GONRG-2591: Airflow 2 backward compatibility 1 of 6 tasks completed

!61 · created Jul 07, 2021 by Yan Sushchynski (EPAM) Airflow2 Manage Ingestion Manifest Based
- MERGED
- Approved
- 1
updated Aug 10, 2021
Included EDS Dataset pattern check 5 of 5 tasks completed

!60 · created Jul 06, 2021 by Rajesh Bollineni
- MERGED
- Approved
- 1
- 1
updated Jul 09, 2021
GONRG-2537: Add cache for Search_records_ids in ManifestIntegrityChecker 1 of 6 tasks completed

!59 · created Jun 30, 2021 by Yan Sushchynski (EPAM) Manifest Based
- MERGED
- Approved
- 0
updated Aug 10, 2021
GONRG-2327: Added possibility to specify custom SA-file for credentials logic 2 of 6 tasks completed

!58 · created Jun 24, 2021 by Siarhei Khaletski (EPAM) M7 - Release 0.10 GCP
- MERGED
- 1
- 0
updated Jun 24, 2021
Preeti/pipeline ado unit test 0 of 1 task completed

!57 · created Jun 09, 2021 by preeti singh[Microsoft]
- MERGED
- Approved
- 13
updated Jun 11, 2021
GONRG-2320: Switch file handler API to v2 1 of 6 tasks completed

!56 · created May 28, 2021 by Yan Sushchynski (EPAM) GCP M6
- MERGED
- Approved
- 0
updated May 28, 2021
Preeti/ManifestIngestionPipeline ado

!55 · created May 24, 2021 by preeti singh[Microsoft]
- MERGED
- Approved
- 27
updated Jun 08, 2021
GONRG-2366: Cursor changed to offsets 5 of 6 tasks completed

!54 · created May 07, 2021 by Siarhei Khaletski (EPAM) Common Code GCP Manifest Based
- MERGED
- 0
updated Aug 10, 2021
GONRG-2017: Add manifest_ingestion test file to repo 1 of 6 tasks completed

!53 · created May 05, 2021 by Yan Sushchynski (EPAM) Common Code GCP M6
- MERGED
- +2
- 0
updated May 13, 2021
GONRG-2213: Fix different validation results 1 of 6 tasks completed

!52 · created May 05, 2021 by Yan Sushchynski (EPAM) Common Code GCP M6 Manifest Based
- MERGED
- +2
- Approved
- 0
updated Aug 10, 2021
fix/GONRG-2291: Skipped reason truncated 1 of 6 tasks completed

!51 · created May 03, 2021 by Yan Sushchynski (EPAM) Common Code GCP M6 Manifest Based
- MERGED
- 2
updated Aug 10, 2021