Commits · b75370d57dd5bced7cffc38d00e9e86645c7bc2a · OSDU / OSDU Data Platform / Data Flow / Data Ingestion / Manifest Ingestion DAG · GitLab

Snippets Groups Projects

Mar 05, 2021
- Fix adding to valid wpc · b75370d5
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b75370d5
- Add constant to single manifest processor · f7c5e607
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  f7c5e607
- GONRG-1912: Add surrogate keys to patterns · 92bbd40c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  92bbd40c
- GONRG-1891: Artifacts processing in WPC · c448c54e
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c448c54e
Mar 04, 2021
- GONRG-1910: fix bug with ingesting master data with pre-defined id · b1778896
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b1778896
- GONRG-1936: fix error with colon symbol in referential ids · b223c6c8
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b223c6c8
Mar 03, 2021
- GONRG-1910: add validation reference ids with versions · fb11caae
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  fb11caae
Mar 02, 2021
- GONRG-1881: add check for WP manifest completeness · c1cf95ec
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c1cf95ec
Mar 01, 2021
- GONRG-1719: updated variables to support ENV approach · 3d0e0f7b
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  3d0e0f7b
Feb 25, 2021
- Add trigger rule to skip batch tasks · 7f1c24f6
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  (cherry picked from commit 8af8301d)
  7f1c24f6
- GONRG-1911: remove : (colon) symbol from the end of reference ids · a4643d8a
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  a4643d8a
- GONRG-1651: Add FileSource validation. · 6fbb5750
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6fbb5750
- GONRG-1770: hotfix variable name · 0b1dfba1
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  0b1dfba1
- GONRG-1770: add composable operator for schema validation · dbdd530b
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  dbdd530b
- GONRG-1719: clean-up and rename airflow variables · 4f2f58a2
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  4f2f58a2
- Handle file variable fix · d2cebc9c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  d2cebc9c
- GONRG-1567: Removed obsolete dags: · 008c172b
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  - default-ingest - other-log-ingest - well-log-ingest
  008c172b
- GONRG-1653: Validate Datasets, WPCs and WP referencial integrity. · e2fc2d0a
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e2fc2d0a
- Fix dag. Remove subdags · b97d68d2
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b97d68d2
- GONRG-1700: fix id composing · 5a58168e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  5a58168e
- GONRG-1650: Batch upload · 58d9e72c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  58d9e72c
- GONRG-1700: add operator for manifest integrity · aed37799
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  aed37799
- GONRG-1689: Pulling authorize logic from Python SDK. · 8fa46a6c
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  8fa46a6c
- Fix download_as_bytes not supported in storage==1.13.2 · 3404cbce
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3404cbce
- GONRG-1652: Replace surrogate keys · 3ede93e4
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3ede93e4
- GONRG-1783: Valdiate entire manifest entity · 7b9e3f0e
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  7b9e3f0e
Feb 24, 2021
- Azure credentials ut · 3f1e48ed
  Kishore Battula authored 4 years ago
  
  3f1e48ed
Feb 19, 2021
- bug fix · 0711d13c
  Shrikant Garg authored 4 years ago
  
  0711d13c
- Fixed issue in environment variable · f5b6fb45
  Kishore Battula authored 4 years ago
  
  f5b6fb45
Feb 12, 2021
- ibm-changes · 6aad54e7
  Shrikant Garg authored 4 years ago
  
  6aad54e7
Feb 09, 2021
- Fix validation of entity inside the manifest (#31 ) · 72bd22d1
  Kishore Battula authored 4 years ago and ethiraj krishnamanaidu committed 4 years ago
  
  72bd22d1
Feb 08, 2021
- GONRG-1709: update workflow service interaction · efc0ff21
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  efc0ff21
Feb 04, 2021
- GONRG-1726: remove ids autogeneration · d1bca150
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  d1bca150
- GONRG-1721: fix pre-defined ids validation error · 558d0d1e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  558d0d1e
Feb 03, 2021
- GONRG-1732: Fix end2end tests · e443c3bc
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e443c3bc
- Fixed import errors with latest sdk · 253a7ceb
  Kishore Battula authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  253a7ceb
- GONRG-1498: Move CSP dependencies to provider folder 2/2. · b2eaf553
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b2eaf553
- GONRG-1498: Move CSP dependencies to provider folder 1/2. · ca11ad40
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  ca11ad40
Feb 01, 2021
- GONRG-1684: add support new R3 manifest structure · 6b7a0990
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6b7a0990
- GONRG-1590:Refresh documentation and add sphinx docstring style. · c1ecd59b
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c1ecd59b