GC Reference Implementation (RI) - M20 - WITSML WELL Parser Ingestion Issue
The WITSML WELL record is not ingesting, the job is failing. { "workflowId": "ee0f0459-50b2-4748-aa91-0574b9c70c7d", "runId": "ed5fec0c-b87c-42c4-996a-d91d179ff142", "startTimeStamp": 1695663706362, "endTimeStamp": 1695664034218, "status": "failed", "submittedBy": "osdu-tester@service.local" } *** Found logs in s3: *** * s3://airflow-log/logs/dag_id=Energistics_xml_ingest/run_id=ed5fec0c-b87c-42c4-996a-d91d179ff142/task_id=update_status_finished_task/attempt=1.log [2023-09-25, 17:47:13 UTC] {taskinstance.py:1103} INFO - Dependencies all met for dep_context=non-requeueable deps ti=<TaskInstance: Energistics_xml_ingest.update_status_finished_task ed5fec0c-b87c-42c4-996a-d91d179ff142 [queued]> [2023-09-25, 17:47:13 UTC] {taskinstance.py:1103} INFO - Dependencies all met for dep_context=requeueable deps ti=<TaskInstance: Energistics_xml_ingest.update_status_finished_task ed5fec0c-b87c-42c4-996a-d91d179ff142 [queued]> [2023-09-25, 17:47:13 UTC] {taskinstance.py:1308} INFO - Starting attempt 1 of 1 [2023-09-25, 17:47:13 UTC] {taskinstance.py:1327} INFO - Executing <Task(UpdateStatusOperator): update_status_finished_task> on 2023-09-25 17:41:46.817099+00:00 [2023-09-25, 17:47:13 UTC] {standard_task_runner.py:57} INFO - Started process 17 to run task [2023-09-25, 17:47:13 UTC] {standard_task_runner.py:84} INFO - Running: ['airflow', 'tasks', 'run', 'Energistics_xml_ingest', 'update_status_finished_task', 'ed5fec0c-b87c-42c4-996a-d91d179ff142', '--job-id', '3753', '--raw', '--subdir', 'DAGS_FOLDER/external/witsml_parser_dag.py', '--cfg-path', '/tmp/tmpfogzfg36'] [2023-09-25, 17:47:13 UTC] {standard_task_runner.py:85} INFO - Job 3753: Subtask update_status_finished_task [2023-09-25, 17:47:13 UTC] {task_command.py:410} INFO - Running <TaskInstance: Energistics_xml_ingest.update_status_finished_task ed5fec0c-b87c-42c4-996a-d91d179ff142 [running]> on host energistics-xml-ingest-update-status-finished-task-e6lxt6of [2023-09-25, 17:47:13 UTC] {pod_generator.py:529} WARNING - Model file does not exist [2023-09-25, 17:47:14 UTC] {taskinstance.py:1545} INFO - Exporting env vars: AIRFLOW_CTX_DAG_OWNER='energistics' AIRFLOW_CTX_DAG_ID='Energistics_xml_ingest' AIRFLOW_CTX_TASK_ID='update_status_finished_task' AIRFLOW_CTX_EXECUTION_DATE='2023-09-25T17:41:46.817099+00:00' AIRFLOW_CTX_TRY_NUMBER='1' AIRFLOW_CTX_DAG_RUN_ID='ed5fec0c-b87c-42c4-996a-d91d179ff142' [2023-09-25, 17:47:14 UTC] {update_status.py:68} INFO - There are failed tasks before this one. So it has status FAILED [2023-09-25, 17:47:14 UTC] {logging_mixin.py:149} INFO - user_id in Context Initialization is None [2023-09-25, 17:47:14 UTC] {taskinstance.py:1824} ERROR - Task failed with exception Traceback (most recent call last): File "/opt/bitnami/airflow/venv/lib/python3.9/site-packages/osdu_airflow/operators/update_status.py", line 158, in execute raise PipelineFailedError("Dag failed") osdu_ingestion.libs.exceptions.PipelineFailedError: Dag failed [2023-09-25, 17:47:14 UTC] {taskinstance.py:1345} INFO - Marking task as FAILED. dag_id=Energistics_xml_ingest, task_id=update_status_finished_task, execution_date=20230925T174146, start_date=20230925T174713, end_date=20230925T174714 [2023-09-25, 17:47:14 UTC] {standard_task_runner.py:104} ERROR - Failed to execute job 3753 for task update_status_finished_task (Dag failed; 17) [2023-09-25, 17:47:14 UTC] {local_task_job_runner.py:225} INFO - Task exited with return code 1 [2023-09-25, 17:47:14 UTC] {taskinstance.py:2651} INFO - 0 downstream tasks scheduled from follow-on schedule check