Merge requests · OSDU Software / OSDU Data Platform / Data Flow / Data Ingestion / Manifest Ingestion DAG

Merge trains

GONRG-2017: Add manifest_ingestion test file to repo 1 of 6 checklist items completed

!53 · created May 05, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
Common Code GC M6
- Merged
- +2
updated Aug 18, 2023
GONRG-2366: Cursor changed to offsets 5 of 6 checklist items completed

!54 · created May 07, 2021 by Siarhei Khaletski (EPAM) M6 - Release 0.9
Common Code GC Manifest Based
updated Aug 18, 2023
Preeti/ManifestIngestionPipeline ado

!55 · created May 24, 2021 by preeti singh[Microsoft] M7 - Release 0.10
- Merged
- 27
- Approved
updated Aug 18, 2023
GONRG-2320: Switch file handler API to v2 1 of 6 checklist items completed

!56 · created May 28, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
GC M6
- Merged
- Approved
updated Aug 18, 2023
Preeti/pipeline ado unit test 0 of 1 checklist item completed

!57 · created Jun 09, 2021 by preeti singh[Microsoft] M7 - Release 0.10
- Merged
- 13
- Approved
updated Aug 18, 2023
GONRG-2327: Added possibility to specify custom SA-file for credentials logic 2 of 6 checklist items completed

!58 · created Jun 24, 2021 by Siarhei Khaletski (EPAM) M7 - Release 0.10
GC
- Merged
- 1
updated Jun 24, 2021
GONRG-2537: Add cache for Search_records_ids in ManifestIntegrityChecker 1 of 6 checklist items completed

!59 · created Jun 30, 2021 by Yan Sushchynski (EPAM) M7 - Release 0.10
Manifest Based
- Merged
- Approved
updated Aug 18, 2023
Included EDS Dataset pattern check 5 of 5 checklist items completed

!60 · created Jul 06, 2021 by Rajesh Bollineni M7 - Release 0.10
- Merged
- 1
- 1
- Approved
updated Aug 18, 2023
GONRG-2591: Airflow 2 backward compatibility 1 of 6 checklist items completed

!61 · created Jul 07, 2021 by Yan Sushchynski (EPAM) M7 - Release 0.10
Manage Ingestion Manifest Based
- Merged
- 1
- Approved
updated Aug 18, 2023
GONRG-2726: Move libs to SDK 1 of 6 checklist items completed

!62 · created Jul 14, 2021 by Yan Sushchynski (EPAM) M7 - Release 0.10
GC
- Merged
- Approved
updated Jul 20, 2021
Azure - Adding Gitlab pipelines 2 of 6 checklist items completed

!63 · created Aug 04, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- 2
- Approved
updated Aug 18, 2023
GONRG-2913: Added support for whitelist reference patterns to exclude from... 1 of 6 checklist items completed

!64 · created Aug 09, 2021 by Aleksandr Spivakov (EPAM) M8 - Release 0.11
GC
- Merged
- 6
- Approved
updated Dec 01, 2022
Azure - Updating ADO pipeline

!65 · created Aug 10, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- 2
- Approved
updated Aug 18, 2023
GONRG-2696: Manifest integrity batch search 2 of 6 checklist items completed

!66 · created Aug 10, 2021 by Yan Sushchynski (EPAM) M8 - Release 0.11
Common Code GC
- Merged
- Approved
updated Aug 23, 2021
Enable Support for Packaged DAGs 1 of 6 checklist items completed

!67 · created Aug 12, 2021 by harshit aggarwal M8 - Release 0.11
Common Code
- Merged
- +2
- 5
- 1
- Approved
updated Aug 26, 2021
Azure - Adding E2E Test Stage 2 of 6 checklist items completed

!68 · created Aug 17, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- 5
- Approved
updated Aug 18, 2023
Azure - Add Test Stage ADO pipeline

!69 · created Aug 18, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- Approved
updated Aug 18, 2023
Ingestion DAG pipeline updated to deploy for both Airflow 1.10.* & 2.0 environments [GONRG-2869]

!70 · created Aug 19, 2021 by Armen Gasparyan (EPAM) M8 - Release 0.11
GC
- Merged
- 12
- 3
- Approved
updated Aug 18, 2023
Azure - pipeline script fix 1 of 6 checklist items completed

!71 · created Aug 24, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- Approved
updated Aug 18, 2023
Azure - Update Test Dag stage 2 of 6 checklist items completed

!73 · created Aug 30, 2021 by harshit aggarwal M9 - Release 0.12
- Merged
- 2
- Approved
updated Aug 18, 2023