Seismic DDMS – 4.3 Trigger OpenVDS Workflow – Dag failed (Airflow)
Dear Members of the OSDU Community,
I wish to formally document a significant issue that has come to my attention during the testing of the Seismic DDMS functionality using the provided Collection within this Environment.
During my testing, I successfully ingested the data and verified logs and XCom in Airflow, confirming the initial stages were successful. However, when I attempted to trigger the SEGY to VDS conversion process and reviewed the Airflow logs, I consistently encountered the following error message:
“[...][2023-08-04, 12:34:41 UTC] {taskinstance.py:1776} ERROR - Task failed with exception
Traceback (most recent call last):
File "/opt/python3.8/lib/python3.8/site-packages/osdu_airflow/operators/update_status.py", line 158, in execute
raise PipelineFailedError("Dag failed")
osdu_ingestion.libs.exceptions.PipelineFailedError: Dag failed
[2023-08-04, 12:34:41 UTC] {taskinstance.py:1279} INFO - Marking task as FAILED. dag_id=Segy_to_vds_conversion_sdms, task_id=update_status_finished, execution_date=20230804T123404, start_date=20230804T123439, end_date=20230804T123441
[2023-08-04, 12:34:41 UTC] {standard_task_runner.py:93} ERROR - Failed to execute job 225535 for task update_status_finished (Dag failed; 372330)
[2023-08-04, 12:34:42 UTC] {local_task_job.py:154} INFO - Task exited with return code 1
[2023-08-04, 12:34:42 UTC] {local_task_job.py:264} INFO - 0 downstream tasks scheduled from follow-on schedule check”
This issue has occurred using both the fgxm19 subproject (runID: 4a93e9ea-b223-45cd-b217-79aff1cbef44) and the testdata subproject (runID: 0f0c69be-2c96-46cf-b116-8a61a6f8c252), resulting in consistent failures of the Dag with the same outcome.
I kindly request the assistance of the OSDU community in diagnosing and resolving this issue. Your attention to this matter is greatly appreciated.
Thank you.