Merge requests · Data Flow

Aws impl, id version bug fix 2 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!40 · created Apr 15, 2021 by Spencer Sutton M5 - Release 0.8
no-detached-pipeline
- Merged
- 3
updated Aug 18, 2023
Ingestion updates 2 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!44 · created Apr 19, 2021 by Yan Sushchynski (EPAM) M5 - Release 0.8
Common Code GC M5 Manifest Based
- Merged
- 3
updated Aug 18, 2023
GONRG-2142: Add lru cache 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!46 · created Apr 26, 2021 by Siarhei Khaletski (EPAM) M6 - Release 0.9
GC
- Merged
- 2
updated Aug 18, 2023
GONRG-2170: Added cursor for search service requests 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!47 · created Apr 27, 2021 by Siarhei Khaletski (EPAM) M6 - Release 0.9
Common Code GC
- Merged
- 8
- Approved
updated Aug 18, 2023
GONRG-2292: Find references with no version in Search 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!48 · created Apr 27, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
Common Code GC
- Merged
- +2
- 3
- Approved
updated Aug 18, 2023
GONRG-2293: Fix Missing colon in parent srn with surrogate-key 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!49 · created Apr 27, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
Common Code GC
- Merged
- +2
- 3
- Approved
updated Aug 18, 2023
fix/GONRG-2103: Pass wrong date-time format 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!50 · created May 03, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
Common Code GC M6 Manifest Based
- Merged
- 4
updated Aug 18, 2023
fix/GONRG-2291: Skipped reason truncated 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!51 · created May 03, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
Common Code GC M6 Manifest Based
- Merged
- 2
updated Aug 18, 2023
GONRG-2213: Fix different validation results 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!52 · created May 05, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
Common Code GC M6 Manifest Based
- Merged
- +2
- Approved
updated Aug 18, 2023
GONRG-2017: Add manifest_ingestion test file to repo 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!53 · created May 05, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
Common Code GC M6
- Merged
- +2
updated Aug 18, 2023
GONRG-2366: Cursor changed to offsets 5 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!54 · created May 07, 2021 by Siarhei Khaletski (EPAM) M6 - Release 0.9
Common Code GC Manifest Based
updated Aug 18, 2023
Preeti/ManifestIngestionPipeline ado

osdu/platform/data-flow/ingestion/ingestion-dags!55 · created May 24, 2021 by preeti singh[Microsoft] M7 - Release 0.10
- Merged
- 27
- Approved
updated Aug 18, 2023
GONRG-2320: Switch file handler API to v2 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!56 · created May 28, 2021 by Yan Sushchynski (EPAM) M6 - Release 0.9
GC M6
- Merged
- Approved
updated Aug 18, 2023
Preeti/pipeline ado unit test 0 of 1 checklist item completed

osdu/platform/data-flow/ingestion/ingestion-dags!57 · created Jun 09, 2021 by preeti singh[Microsoft] M7 - Release 0.10
- Merged
- 13
- Approved
updated Aug 18, 2023
GONRG-2537: Add cache for Search_records_ids in ManifestIntegrityChecker 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!59 · created Jun 30, 2021 by Yan Sushchynski (EPAM) M7 - Release 0.10
Manifest Based
- Merged
- Approved
updated Aug 18, 2023
Included EDS Dataset pattern check 5 of 5 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!60 · created Jul 06, 2021 by Rajesh Bollineni M7 - Release 0.10
- Merged
- 1
- 1
- Approved
updated Aug 18, 2023
GONRG-2591: Airflow 2 backward compatibility 1 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!61 · created Jul 07, 2021 by Yan Sushchynski (EPAM) M7 - Release 0.10
Manage Ingestion Manifest Based
- Merged
- 1
- Approved
updated Aug 18, 2023
Azure - Adding Gitlab pipelines 2 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!63 · created Aug 04, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- 2
- Approved
updated Aug 18, 2023
Azure - Updating ADO pipeline

osdu/platform/data-flow/ingestion/ingestion-dags!65 · created Aug 10, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- 2
- Approved
updated Aug 18, 2023
Azure - Adding E2E Test Stage 2 of 6 checklist items completed

osdu/platform/data-flow/ingestion/ingestion-dags!68 · created Aug 17, 2021 by harshit aggarwal M8 - Release 0.11
- Merged
- 5
- Approved
updated Aug 18, 2023