Commits · b97d68d26316238339476cfcef86985ba8f57dbd · OSDU / OSDU Data Platform / Data Flow / Data Ingestion / Manifest Ingestion DAG · GitLab

Snippets Groups Projects

Feb 25, 2021
- Fix dag. Remove subdags · b97d68d2
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b97d68d2
- GONRG-1700: fix id composing · 5a58168e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  5a58168e
- GONRG-1650: Batch upload · 58d9e72c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  58d9e72c
- GONRG-1700: add operator for manifest integrity · aed37799
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  aed37799
- GONRG-1689: Pulling authorize logic from Python SDK. · 8fa46a6c
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  8fa46a6c
- Fix download_as_bytes not supported in storage==1.13.2 · 3404cbce
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3404cbce
- GONRG-1652: Replace surrogate keys · 3ede93e4
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3ede93e4
- GONRG-1783: Valdiate entire manifest entity · 7b9e3f0e
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  7b9e3f0e
Feb 24, 2021
- Azure credentials ut · 3f1e48ed
  Kishore Battula authored 4 years ago
  
  3f1e48ed
Feb 19, 2021
- bug fix · 0711d13c
  Shrikant Garg authored 4 years ago
  
  0711d13c
- Fixed issue in environment variable · f5b6fb45
  Kishore Battula authored 4 years ago
  
  f5b6fb45
Feb 12, 2021
- ibm-changes · 6aad54e7
  Shrikant Garg authored 4 years ago
  
  6aad54e7
Feb 09, 2021
- Fix validation of entity inside the manifest (#31 ) · 72bd22d1
  Kishore Battula authored 4 years ago and ethiraj krishnamanaidu committed 4 years ago
  
  72bd22d1
Feb 08, 2021
- GONRG-1709: update workflow service interaction · efc0ff21
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  efc0ff21
Feb 04, 2021
- GONRG-1726: remove ids autogeneration · d1bca150
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  d1bca150
- GONRG-1721: fix pre-defined ids validation error · 558d0d1e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  558d0d1e
Feb 03, 2021
- GONRG-1732: Fix end2end tests · e443c3bc
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e443c3bc
- Fixed import errors with latest sdk · 253a7ceb
  Kishore Battula authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  253a7ceb
- GONRG-1498: Move CSP dependencies to provider folder 2/2. · b2eaf553
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b2eaf553
- GONRG-1498: Move CSP dependencies to provider folder 1/2. · ca11ad40
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  ca11ad40
Feb 01, 2021
- GONRG-1684: add support new R3 manifest structure · 6b7a0990
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6b7a0990
- GONRG-1590:Refresh documentation and add sphinx docstring style. · c1ecd59b
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c1ecd59b
- Add new file service ingestion flow. · 3a237f2c
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3a237f2c
Dec 29, 2020
- GONRG-1457: Stopped replacing fileSource · e0146e3d
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e0146e3d
Dec 10, 2020
- Add content type to upload file. Fix typo · 3a2819f8
  Yan Sushchynski (EPAM) authored 4 years ago
  
  3a2819f8
- Turn off id validation · 1d90d133
  Yan Sushchynski (EPAM) authored 4 years ago
  
  1d90d133
Dec 09, 2020
- GONRG-1317: Add file uploader · 630e79f7
  Yan Sushchynski (EPAM) authored 4 years ago
  
  630e79f7
- GONRG-1213: Add source file validation · ffe0e9cf
  Yan Sushchynski (EPAM) authored 4 years ago
  
  ffe0e9cf
Dec 04, 2020
- GONRG-1269: Tests for operators · 68f80897
  Yan Sushchynski (EPAM) authored 4 years ago
  
  68f80897
Nov 25, 2020
- GONRG-1180: Add refresh token using bucket · 43c5ff47
  Yan Sushchynski (EPAM) authored 4 years ago
  
  43c5ff47
- GONRG-1183: Add process workproducts · f885564a
  Yan Sushchynski (EPAM) authored 4 years ago
  
  f885564a
Nov 11, 2020
- GONRG-1011: Create process manifest class · bb8397f9
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  bb8397f9
- GONRG-1011: Renamed Osdu_ingest DAG to Osdu_ingest_r2. · b94178eb
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  b94178eb
Oct 27, 2020
- GONRG-790: Change naming. Add retry to get_token. · 710b8152
  Yan Sushchynski (EPAM) authored 4 years ago
  
  710b8152
- GONRG-790: Add refresh token decorator. · 58e8c1d8
  Yan Sushchynski (EPAM) authored 4 years ago
  
  58e8c1d8
Sep 04, 2020
- GONRG-474 Unified CICD and folders structure · 88f31245
  Oleksandr Kosse (EPAM) authored 4 years ago
  
  88f31245
- GONRG-474: Add libs folder to find third-party libs in dags. Change path to... · 1d8b53af
  Oleksandr Kosse (EPAM) authored 4 years ago
  
  GONRG-474: Add libs folder to find third-party libs in dags. Change path to SearhRecordIdOp in init file
  1d8b53af
Aug 21, 2020
- GONRG-568: Changed structure. Added linter. Make linter steps pass · 3e906895
  Yan Sushchynski (EPAM) authored 4 years ago
  
  3e906895