[IBM R3M9](Segy to Ovds conversion) Air flow DAG failure after run Segy to Vds” conversation
I had run a [R3M9 IBM ] “Segy to Vds” conversation task, but I found that the DAG(openvds_import) is failed to process my workflow.
Request :
Post Method: {{WORKFLOW_HOST}}/workflow/{{workflow_name_openvds}}/workflowRun
Body:
{
"executionContext": {
"url_connection": "sdauthorityurl=https://{{osdu-cpd}}/osdu-seismic/api/v3;sdapikey=xx;sdtoken={{access_token}};EndpointOverride={{minio-url}}",
"input_connection": "sdauthorityurl=https://{{osdu-cpd}}/osdu-seismic/api/v3;sdapikey=xx;sdtoken={{access_token}};EndpointOverride={{minio-url}}",
"segy_file": "sd://opendes/kenneth-test/ST10010ZC11_PZ_PSDM_KIRCH_NEAR_D.MIG_FIN.POST_STACK.3D.JS-017536_Version4.segy",
"url": "sd://opendes/kenneth-test/"
}
}Response:
{
"workflowId": "b133573249894456a32813caac1bf692",
"runId": "e831ba7b-6e80-4c0a-ba83-05cfa55cf309",
"startTimeStamp": 1639650166798,
"status": "submitted",
"submittedBy": "preshipteama@osdu.opengroup.org"
}AirFlow DAG log-openvds_import
2021-12-16 10:24:51,867] {taskinstance.py:1501} ERROR - Task failed with exception
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 366, in execute
final_state, remote_pod, result = self.create_new_pod_for_operator(labels, launcher)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 519, in create_new_pod_for_operator
launcher.start_pod(self.pod, startup_timeout=self.startup_timeout_seconds)
File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 329, in wrapped_f
return self.call(f, *args, **kw)
File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 409, in call
do = self.iter(retry_state=retry_state)
File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 356, in iter
return fut.result()
File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 437, in result
return self.__get_result()
File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 412, in call
result = fn(*args, **kwargs)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/utils/pod_launcher.py", line 131, in start_pod
raise AirflowException("Pod took too long to start")
airflow.exceptions.AirflowException: Pod took too long to start
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1157, in _run_raw_task
self._prepare_and_execute_task_with_callbacks(context, task)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1331, in _prepare_and_execute_task_with_callbacks
result = self._execute_task(context, task_copy)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1361, in _execute_task
result = task_copy.execute(context=context)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 373, in execute
raise AirflowException(f'Pod Launching failed: {ex}')
airflow.exceptions.AirflowException: Pod Launching failed: Pod took too long to start
[2021-12-16 10:24:51,873] {taskinstance.py:1544} INFO - Marking task as FAILED. dag_id=openvds_import, task_id=OPENVDS, execution_date=20211216T102247, start_date=20211216T102249, end_date=20211216T102451
[2021-12-16 10:24:51,959] {local_task_job.py:151} INFO - Task exited with return code 1