Commits · fab381c4e1f77233d8f21b1eb08a6db4797565e4 · OSDU / OSDU Data Platform / Data Flow / Data Ingestion / Manifest Ingestion DAG · GitLab

Snippets Groups Projects

Sep 09, 2021
- GONRG-3109: move common logic to osdu-airflow-lib · 23dcb378
  Aleksandr Spivakov (EPAM) authored 3 years ago
  
  23dcb378
Sep 08, 2021
- GONRG-3107: Change backward compatibility · 2d1ffd71
  Yan Sushchynski (EPAM) authored 3 years ago
  
  2d1ffd71
Aug 20, 2021
- Enable Support for Packaged DAGs · 44c45268
  harshit aggarwal authored 3 years ago
  
  44c45268
Jul 14, 2021
- GONRG-2726: Move libs to SDK · c45a7557
  Yan Sushchynski (EPAM) authored 3 years ago
  
  c45a7557
Jun 30, 2021
- GONRG-2537: Add cache for Search_records_ids in ManifestIntegrityChecker · 2bb11f9c
  Yan Sushchynski (EPAM) authored 3 years ago
  
  2bb11f9c
May 28, 2021
- GONRG-2320: Switch file handler API to v2 · ed7d2d91
  Yan Sushchynski (EPAM) authored 3 years ago
  
  ed7d2d91
May 07, 2021
- GONRG-2366: Due to the issues with Search with cursor it replaced to query with offsets · c2b41cce
  Siarhei Khaletski (EPAM) authored 3 years ago
  
  c2b41cce
May 05, 2021
- GONRG-2213: Fix different validation results · 1bd7632c
  Yan Sushchynski (EPAM) authored 3 years ago
  
  1bd7632c
May 03, 2021
- GONRG-2103: Fix entity passes validation with wrong formats · e992b3ef
  Yan Sushchynski (EPAM) authored 3 years ago
  
  e992b3ef
Apr 27, 2021
- GONRG-2293: Fix Missing colon in parent srn with surrogate-key · 63528eeb
  Yan Sushchynski (EPAM) authored 3 years ago
  
  63528eeb
- GONRG-2292: Find references with no version in Search · b49b28c3
  Yan Sushchynski (EPAM) authored 3 years ago
  
  b49b28c3
- GONRG-2170: Added cursor for search service requests · f2a87b36
  Siarhei Khaletski (EPAM) authored 3 years ago
  
  f2a87b36
Apr 26, 2021
- GONRG-2142: Add lru cache · e59469e5
  Yan Sushchynski (EPAM) authored 3 years ago and Siarhei Khaletski (EPAM) committed 3 years ago
  
  e59469e5
Apr 21, 2021
- Ingestion updates · b9c1a071
  Yan Sushchynski (EPAM) authored 3 years ago and Rostislav Dublin (EPAM) committed 3 years ago
  
  b9c1a071
Apr 19, 2021
- Aws impl, id version bug fix · 545b62be
  Spencer Sutton authored 3 years ago
  
  545b62be
Mar 23, 2021
- Add BaseTokenRefresher · 48e9789a
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  48e9789a
Mar 18, 2021
- GONRG-1961: Fix pipline fails · 64df438a
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  64df438a
- GONRG-1941: Fix space char in FileSource · d38d6f2e
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  d38d6f2e
Mar 11, 2021
- GONRG-1932: Refactor referential integrity · 4f02c1db
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  4f02c1db
Mar 05, 2021
- Fix adding to valid wpc · b75370d5
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b75370d5
- GONRG-1912: Add surrogate keys to patterns · 92bbd40c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  92bbd40c
- GONRG-1891: Artifacts processing in WPC · c448c54e
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c448c54e
Mar 04, 2021
- GONRG-1866: add condition statement to import vendors dependencies · 8938fc43
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  8938fc43
- GONRG-1910: fix bug with ingesting master data with pre-defined id · b1778896
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b1778896
- GONRG-1936: fix error with colon symbol in referential ids · b223c6c8
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b223c6c8
Mar 03, 2021
- GONRG-1910: add validation reference ids with versions · fb11caae
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  fb11caae
Mar 02, 2021
- GONRG-1881: add check for WP manifest completeness · c1cf95ec
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c1cf95ec
Mar 01, 2021
- GONRG-1719: updated variables to support ENV approach · 3d0e0f7b
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  3d0e0f7b
Feb 25, 2021
- GONRG-1911: remove : (colon) symbol from the end of reference ids · a4643d8a
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  a4643d8a
- GONRG-1651: Add FileSource validation. · 6fbb5750
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6fbb5750
- GONRG-1770: add composable operator for schema validation · dbdd530b
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  dbdd530b
- GONRG-1719: clean-up and rename airflow variables · 4f2f58a2
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  4f2f58a2
- GONRG-1567: Removed obsolete dags: · 008c172b
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  - default-ingest - other-log-ingest - well-log-ingest
  008c172b
- GONRG-1653: Validate Datasets, WPCs and WP referencial integrity. · e2fc2d0a
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e2fc2d0a
- GONRG-1700: fix id composing · 5a58168e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  5a58168e
- GONRG-1650: Batch upload · 58d9e72c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  58d9e72c
- GONRG-1700: add operator for manifest integrity · aed37799
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  aed37799
- GONRG-1689: Pulling authorize logic from Python SDK. · 8fa46a6c
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  8fa46a6c
- Fix download_as_bytes not supported in storage==1.13.2 · 3404cbce
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3404cbce
- GONRG-1652: Replace surrogate keys · 3ede93e4
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3ede93e4