Commits · fab381c4e1f77233d8f21b1eb08a6db4797565e4 · OSDU / OSDU Data Platform / Data Flow / Data Ingestion / Manifest Ingestion DAG · GitLab

Snippets Groups Projects

Sep 09, 2021
- GONRG-3109: move common logic to osdu-airflow-lib · 23dcb378
  Aleksandr Spivakov (EPAM) authored 3 years ago
  
  23dcb378
Sep 08, 2021
- GONRG-3107: Change backward compatibility · 2d1ffd71
  Yan Sushchynski (EPAM) authored 3 years ago
  
  2d1ffd71
Aug 20, 2021
- Enable Support for Packaged DAGs · 44c45268
  harshit aggarwal authored 3 years ago
  
  44c45268
Jul 14, 2021
- GONRG-2726: Move libs to SDK · c45a7557
  Yan Sushchynski (EPAM) authored 3 years ago
  
  c45a7557
Jul 07, 2021
- GONRG-2591: Airflow 2 backward compatibility · ac010abd
  Yan Sushchynski (EPAM) authored 3 years ago
  
  ac010abd
Mar 01, 2021
- GONRG-1719: updated variables to support ENV approach · 3d0e0f7b
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  3d0e0f7b
Feb 25, 2021
- Add trigger rule to skip batch tasks · 7f1c24f6
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  (cherry picked from commit 8af8301d)
  7f1c24f6
- GONRG-1770: add composable operator for schema validation · dbdd530b
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  dbdd530b
- GONRG-1719: clean-up and rename airflow variables · 4f2f58a2
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  4f2f58a2
- Fix dag. Remove subdags · b97d68d2
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  b97d68d2
- GONRG-1650: Batch upload · 58d9e72c
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  58d9e72c
- GONRG-1700: add operator for manifest integrity · aed37799
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  aed37799
Feb 08, 2021
- GONRG-1709: update workflow service interaction · efc0ff21
  Dmitrii Valuiskii (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  efc0ff21
Feb 01, 2021
- GONRG-1590:Refresh documentation and add sphinx docstring style. · c1ecd59b
  Ernesto Gutierrez authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  c1ecd59b
Nov 25, 2020
- GONRG-1180: Add refresh token using bucket · 43c5ff47
  Yan Sushchynski (EPAM) authored 4 years ago
  
  43c5ff47
- GONRG-1183: Add process workproducts · f885564a
  Yan Sushchynski (EPAM) authored 4 years ago
  
  f885564a
Nov 11, 2020
- GONRG-1011: Create process manifest class · bb8397f9
  Yan Sushchynski (EPAM) authored 4 years ago and Siarhei Khaletski (EPAM) committed 4 years ago
  
  bb8397f9
- GONRG-1011: Renamed Osdu_ingest DAG to Osdu_ingest_r2. · b94178eb
  Siarhei Khaletski (EPAM) authored 4 years ago
  
  b94178eb
Oct 27, 2020
- GONRG-790: Add refresh token decorator. · 58e8c1d8
  Yan Sushchynski (EPAM) authored 4 years ago
  
  58e8c1d8
Sep 04, 2020
- GONRG-474 Unified CICD and folders structure · 88f31245
  Oleksandr Kosse (EPAM) authored 4 years ago
  
  88f31245
- GONRG-474: Add libs folder to find third-party libs in dags. Change path to... · 1d8b53af
  Oleksandr Kosse (EPAM) authored 4 years ago
  
  GONRG-474: Add libs folder to find third-party libs in dags. Change path to SearhRecordIdOp in init file
  1d8b53af
Aug 21, 2020
- GONRG-568: Changed structure. Added linter. Make linter steps pass · 3e906895
  Yan Sushchynski (EPAM) authored 4 years ago
  
  3e906895
Jul 15, 2020
- Publish manifest-based ingestion workflow · 8b8f9862
  Dmitriy Rudko authored 4 years ago and ethiraj krishnamanaidu committed 4 years ago
  
  8b8f9862
May 15, 2020
- Story #1040 - Initial pull from Google GitHub · db25d350
  Dmitriy Rudko authored 4 years ago
  
  db25d350