Commit 34bbc848 authored by Siarhei Khaletski (EPAM)'s avatar Siarhei Khaletski (EPAM) 🚩
Browse files

Merge branch 'GONRG-3107_Change_backward_compatibility_logic' into 'master'

GONRG-3107: Change backward compatibility

See merge request osdu/platform/data-flow/ingestion/energistics-osdu-integration!31
parents f5672ec1 f1e14ce9
Pipeline #63939 skipped with stages
......@@ -243,6 +243,17 @@ DAG's tasks:
1. *process_single_manifest_file_task* prepare every entity to be stored on Storage sevice and store it.
1. *update_status_finished_task* requires *workflowID* to change a workflow state from *running* to either *finished* or *failed*. If any previous task is failed, the DAG is marked as failed and the status *failed* is sent to the Workflow Service, otherwise the DAG is marked as successful and the status *finished* is sent to the Workflow Service.
#### Requirements
The [Airflow DAG](/airflow/workflow-svc-v2/segy_to_zgy_ingestion_dag.py) has dependencies from [osdu-airflow-lib](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib) package for common operators and backward compatibility.
Install it in Airflow Environment:
```shell
pip install 'osdu-airflow' --extra-index-url=https://community.opengroup.org/api/v4/projects/668/packages/pypi/simple
```
## Prerequisites
WITSML Parser requires the following packages:
......
......@@ -21,8 +21,8 @@ from datetime import timedelta
import airflow
import yaml
from airflow import DAG
from osdu_manifest.libs.airflow.backward_compatibility.default_args import update_default_args
from airflow.contrib.operators.kubernetes_pod_operator import KubernetesPodOperator
from osdu_airflow.backward_compatibility.default_args import update_default_args
from osdu_manifest.operators.ensure_manifest_integrity import EnsureManifestIntegrityOperator
from osdu_manifest.operators.process_manifest_r3 import ProcessManifestOperatorR3
from osdu_manifest.operators.validate_manifest_schema import ValidateManifestSchemaOperator
......
# It needs to be installed in Airflow Environment
--extra-index-url=https://community.opengroup.org/api/v4/projects/668/packages/pypi/simple/
osdu-airflow==0.0.1
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment