Commits · 3d0e0f7b1aa5ab4c2c6088314b1d27b0aded8db8 · OSDU / OSDU Data Platform / Data Flow / Data Ingestion / Manifest Ingestion DAG · GitLab

Snippets Groups Projects

Mar 01, 2021
- GONRG-1719: updated variables to support ENV approach · 3d0e0f7b
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  3d0e0f7b
Feb 25, 2021
- Add trigger rule to skip batch tasks · 7f1c24f6
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  (cherry picked from commit 8af8301d)
  7f1c24f6
- GONRG-1911: remove : (colon) symbol from the end of reference ids · a4643d8a
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  a4643d8a
- GONRG-1651: Add FileSource validation. · 6fbb5750
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6fbb5750
- GONRG-1770: hotfix variable name · 0b1dfba1
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  0b1dfba1
- GONRG-1770: add composable operator for schema validation · dbdd530b
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  dbdd530b
- GONRG-1719: clean-up and rename airflow variables · 4f2f58a2
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  4f2f58a2
- Handle file variable fix · d2cebc9c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  d2cebc9c
- GONRG-1567: Removed obsolete dags: · 008c172b
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  - default-ingest - other-log-ingest - well-log-ingest
  008c172b
- GONRG-1653: Validate Datasets, WPCs and WP referencial integrity. · e2fc2d0a
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e2fc2d0a
- Fix dag. Remove subdags · b97d68d2
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b97d68d2
- GONRG-1700: fix id composing · 5a58168e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  5a58168e
- GONRG-1650: Batch upload · 58d9e72c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  58d9e72c
- GONRG-1700: add operator for manifest integrity · aed37799
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  aed37799
- GONRG-1689: Pulling authorize logic from Python SDK. · 8fa46a6c
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  8fa46a6c
- Fix download_as_bytes not supported in storage==1.13.2 · 3404cbce
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3404cbce
- GONRG-1652: Replace surrogate keys · 3ede93e4
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3ede93e4
- GONRG-1783: Valdiate entire manifest entity · 7b9e3f0e
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  7b9e3f0e
Feb 24, 2021
- Azure credentials ut · 3f1e48ed
  Kishore Battula authored 4 years ago
  
  3f1e48ed
Feb 19, 2021
- bug fix · 0711d13c
  Shrikant Garg authored 4 years ago
  
  0711d13c
- Fixed issue in environment variable · f5b6fb45
  Kishore Battula authored 4 years ago
  
  f5b6fb45
Feb 12, 2021
- ibm-changes · 6aad54e7
  Shrikant Garg authored 4 years ago
  
  6aad54e7
Feb 09, 2021
- Fix validation of entity inside the manifest (#31 ) · 72bd22d1
  Kishore Battula authored 4 years ago and ethiraj krishnamanaidu committed 4 years ago
  
  72bd22d1
Feb 08, 2021
- GONRG-1709: update workflow service interaction · efc0ff21
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  efc0ff21
Feb 04, 2021
- GONRG-1726: remove ids autogeneration · d1bca150
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  d1bca150
- GONRG-1721: fix pre-defined ids validation error · 558d0d1e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  558d0d1e
Feb 03, 2021
- GONRG-1732: Fix end2end tests · e443c3bc
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e443c3bc
- Fixed import errors with latest sdk · 253a7ceb
  Kishore Battula authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  253a7ceb
- GONRG-1498: Move CSP dependencies to provider folder 2/2. · b2eaf553
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b2eaf553
- GONRG-1498: Move CSP dependencies to provider folder 1/2. · ca11ad40
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  ca11ad40
Feb 01, 2021
- GONRG-1684: add support new R3 manifest structure · 6b7a0990
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6b7a0990
- GONRG-1590:Refresh documentation and add sphinx docstring style. · c1ecd59b
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c1ecd59b
- Add new file service ingestion flow. · 3a237f2c
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3a237f2c
Dec 29, 2020
- GONRG-782: add support custom acl and legal tag. update tests. · 6574658f
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6574658f
- GONRG-1457: Stopped replacing fileSource · e0146e3d
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e0146e3d
Dec 10, 2020
- Add content type to upload file. Fix typo · 3a2819f8
  Yan Sushchynski (EPAM) authored 4 years ago
  
  3a2819f8
- Turn off id validation · 1d90d133
  Yan Sushchynski (EPAM) authored 4 years ago
  
  1d90d133
Dec 09, 2020
- GONRG-1317: Add file uploader · 630e79f7
  Yan Sushchynski (EPAM) authored 4 years ago
  
  630e79f7
- GONRG-1213: Add source file validation · ffe0e9cf
  Yan Sushchynski (EPAM) authored 4 years ago
  
  ffe0e9cf
Dec 04, 2020
- GONRG-1269: Tests for operators · 68f80897
  Yan Sushchynski (EPAM) authored 4 years ago
  
  68f80897