Commits · d1bca15067dc9dae9c7f54946e82bf0ea0d6ad86 · OSDU / OSDU Data Platform / Data Flow / Data Ingestion / Manifest Ingestion DAG · GitLab

Snippets Groups Projects

Feb 04, 2021
- GONRG-1726: remove ids autogeneration · d1bca150
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  d1bca150
- GONRG-1721: fix pre-defined ids validation error · 558d0d1e
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  558d0d1e
Feb 03, 2021
- Merge branch 'feature/providers_logic_split' into 'master' · cca0b300
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  Feature/providers logic split See merge request !10
  cca0b300
- GONRG-1685:Fix upload providers folder. · 1a367620
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  1a367620
- GONRG-1732: Fix end2end tests · e443c3bc
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e443c3bc
- Fixed import errors with latest sdk · 253a7ceb
  Kishore Battula authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  253a7ceb
- GONRG-1498: Move CSP dependencies to provider folder 2/2. · b2eaf553
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b2eaf553
- GONRG-1498: Move CSP dependencies to provider folder 1/2. · ca11ad40
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  ca11ad40
Feb 01, 2021
- Merge branch 'feature/r3_updates' into 'master' · 38c0c24b
  Dmitriy Rudko authored 4 years ago
  
  R3 updates See merge request !9
  38c0c24b
- GONRG-1684: add support new R3 manifest structure · 6b7a0990
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6b7a0990
- GONRG-1590:Refresh documentation and add sphinx docstring style. · c1ecd59b
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c1ecd59b
- Add new file service ingestion flow. · 3a237f2c
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  3a237f2c
Jan 04, 2021
- Merge branch 'r3_ingestion_updates' into 'master' · 45c3095c
  Dmitriy Rudko authored 4 years ago
  
  R3 ingestion updates See merge request !7
  45c3095c
- GONRG-1402: Fix Community CI to run deployment step only if GIT branch is protected. · 263c7818
  Dmitriy Rudko authored 4 years ago
  
  263c7818
Dec 29, 2020
- GONRG-1402: Added Logger Section for README.md file · c1a095b3
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  c1a095b3
- GONRG-782: add support custom acl and legal tag. update tests. · 6574658f
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  6574658f
- GONRG-1457: Stopped replacing fileSource · e0146e3d
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  e0146e3d
Dec 14, 2020
- Merge branch 'feature/r3-data-ingestion' into 'master' · e3da8d52
  Dmitriy Rudko authored 4 years ago
  
  R3 Data Ingestion See merge request !6
  e3da8d52
- Removed schema_registration tmp commit · 284e7fa4
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  284e7fa4
- Merge branch 'Add_Content_Type_to_uploaded_file' into 'integration-master' · 454bd6a6
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  Add content type to upload file. Fix typo See merge request go3-nrg/platform/data-flow/ingestion/ingestion-dags!21
  454bd6a6
Dec 10, 2020
- Add content type to upload file. Fix typo · 3a2819f8
  Yan Sushchynski (EPAM) authored 4 years ago
  
  3a2819f8
- Turn off id validation · 1d90d133
  Yan Sushchynski (EPAM) authored 4 years ago
  
  1d90d133
Dec 09, 2020
- Merge branch 'feature/GONRG-1213_Validation_file_exists' into 'integration-master' · 2a99a125
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  GONRG-1213 GONRG-1317 "Validation file exists and uploading files into OSDU using preloadFilePath" See merge request go3-nrg/platform/data-flow/ingestion/ingestion-dags!19
  2a99a125
- GONRG-1317: Add file uploader · 630e79f7
  Yan Sushchynski (EPAM) authored 4 years ago
  
  630e79f7
- GONRG-1213: Add source file validation · ffe0e9cf
  Yan Sushchynski (EPAM) authored 4 years ago
  
  ffe0e9cf
Dec 04, 2020
- Merge branch 'feature/GONRG-1269_Refactor_and_unit_tests' into 'integration-master' · 74ebe022
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  GONRG-1269 "Feature/ refactor and unit tests" See merge request go3-nrg/platform/data-flow/ingestion/ingestion-dags!18
  74ebe022
- GONRG-1269: Tests for operators · 68f80897
  Yan Sushchynski (EPAM) authored 4 years ago
  
  68f80897
Nov 25, 2020
- Merge branch 'GONRG-1183_Generic_load_WP' into 'integration-master' · 3b4a1c74
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  GONRG-1183 Generic load WP See merge request go3-nrg/platform/data-flow/ingestion/ingestion-dags!15
  3b4a1c74
- GONRG-1183: Merge branch 'integration-master' into GONRG-1183_Generic_load_WP · 1a520925
  Yan Sushchynski (EPAM) authored 4 years ago
  
  1a520925
- Merge branch 'GONRG-1180_SA_file_for_access_token' into 'integration-master' · 543b4cca
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  GONRG-1180: Add refresh token using bucket See merge request go3-nrg/platform/data-flow/ingestion/ingestion-dags!16
  543b4cca
- GONRG-1180: Add refresh token using bucket · 43c5ff47
  Yan Sushchynski (EPAM) authored 4 years ago
  
  43c5ff47
- GONRG-1183: Add process workproducts · f885564a
  Yan Sushchynski (EPAM) authored 4 years ago
  
  f885564a
Nov 19, 2020
- GONRG-1183: Add script to replace invalid values in schemas · e9d48875
  Yan Sushchynski (EPAM) authored 4 years ago
  
  e9d48875
Nov 11, 2020
- Merge branch 'feature/GONRG-952_r3_data_ingestion' into 'integration-master' · f2a67962
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  R3 Reference and Master data ingestion See merge request go3-nrg/platform/data-flow/ingestion/ingestion-dags!14
  f2a67962
- GONRG-1011: Remove schema_registration folder to keep MR clean · 1551cb6a
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  1551cb6a
- GONRG-1011: Create process manifest class · bb8397f9
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  bb8397f9
- GONRG-1011: Renamed Osdu_ingest DAG to Osdu_ingest_r2. · b94178eb
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  b94178eb
- GONRG-1007: Add abstract schemas to register · e0cab95b
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  GONRG-953: Add schema valdiation script and test data GONRG-952: Add schemas refference. Refactore schema-valid
  e0cab95b
Oct 28, 2020
- Merge branch 'GONRG-790_Access_token_using_SA' into 'integration-master' · f0cd1baf
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  GONRG-790 "Access token using sa" See merge request go3-nrg/platform/data-flow/ingestion/ingestion-dags!12
  f0cd1baf
Oct 27, 2020
- GONRG-790: Change naming. Add retry to get_token. · 710b8152
  Yan Sushchynski (EPAM) authored 4 years ago
  
  710b8152