Publish manifest-based ingestion workflow
Showing
- .gitattributes 1 addition, 0 deletions.gitattributes
- .gitlab-ci.yml 24 additions, 21 deletions.gitlab-ci.yml
- dags/configs/dataload.ini 119 additions, 0 deletionsdags/configs/dataload.ini
- dags/create_records.py 30 additions, 11 deletionsdags/create_records.py
- dags/default-ingest.py 19 additions, 4 deletionsdags/default-ingest.py
- dags/osdu-ingest.py 59 additions, 0 deletionsdags/osdu-ingest.py
- dags/other-log-ingest.py 1 addition, 0 deletionsdags/other-log-ingest.py
- dags/well-log-ingest.py 0 additions, 0 deletionsdags/well-log-ingest.py
- plugins/__init__.py 22 additions, 0 deletionsplugins/__init__.py
- plugins/hooks/__init__.py 16 additions, 0 deletionsplugins/hooks/__init__.py
- plugins/hooks/http_hooks.py 19 additions, 0 deletionsplugins/hooks/http_hooks.py
- plugins/operators/__init__.py 22 additions, 0 deletionsplugins/operators/__init__.py
- plugins/operators/process_manifest_op.py 330 additions, 0 deletionsplugins/operators/process_manifest_op.py
- plugins/operators/update_status_op.py 173 additions, 0 deletionsplugins/operators/update_status_op.py
- plugins/operators/update_status_tasks.py 173 additions, 0 deletionsplugins/operators/update_status_tasks.py
- plugins/tests/__init__.py 15 additions, 0 deletionsplugins/tests/__init__.py
- plugins/tests/data/__init__.py 16 additions, 0 deletionsplugins/tests/data/__init__.py
- plugins/tests/data/process_manifest_op.py 106 additions, 0 deletionsplugins/tests/data/process_manifest_op.py
- plugins/tests/test_process_manifest_op.py 65 additions, 0 deletionsplugins/tests/test_process_manifest_op.py
- tests/README.md 8 additions, 0 deletionstests/README.md
Loading
Please register or sign in to comment