*** Log file does not exist: /opt/airflow/logs/openvds_import/OPENVDS/2021-12-16T10:22:47.004628+00:00/1.log *** Fetching from: http://airflow-worker-0.airflow-worker.osdu-airflow.svc.cluster.local:8793/log/openvds_import/OPENVDS/2021-12-16T10:22:47.004628+00:00/1.log [2021-12-16 10:22:49,030] {taskinstance.py:896} INFO - Dependencies all met for [2021-12-16 10:22:49,064] {taskinstance.py:896} INFO - Dependencies all met for [2021-12-16 10:22:49,065] {taskinstance.py:1087} INFO - -------------------------------------------------------------------------------- [2021-12-16 10:22:49,065] {taskinstance.py:1088} INFO - Starting attempt 1 of 1 [2021-12-16 10:22:49,067] {taskinstance.py:1089} INFO - -------------------------------------------------------------------------------- [2021-12-16 10:22:49,085] {taskinstance.py:1107} INFO - Executing on 2021-12-16T10:22:47.004628+00:00 [2021-12-16 10:22:49,092] {standard_task_runner.py:52} INFO - Started process 147 to run task [2021-12-16 10:22:49,105] {standard_task_runner.py:76} INFO - Running: ['***', 'tasks', 'run', 'openvds_import', 'OPENVDS', '2021-12-16T10:22:47.004628+00:00', '--job-id', '9908', '--pool', 'default_pool', '--raw', '--subdir', 'DAGS_FOLDER/segy_to_vds_ssdms_conversion_dag.py', '--cfg-path', '/tmp/tmp22bn6jp3', '--error-file', '/tmp/tmpeqsde6ho'] [2021-12-16 10:22:49,107] {standard_task_runner.py:77} INFO - Job 9908: Subtask OPENVDS [2021-12-16 10:22:49,211] {logging_mixin.py:104} INFO - Running on host ***-worker-0.***-worker.osdu-***.svc.cluster.local [2021-12-16 10:22:49,371] {taskinstance.py:1300} INFO - Exporting the following env vars: AIRFLOW_CTX_DAG_OWNER=*** AIRFLOW_CTX_DAG_ID=openvds_import AIRFLOW_CTX_TASK_ID=OPENVDS AIRFLOW_CTX_EXECUTION_DATE=2021-12-16T10:22:47.004628+00:00 AIRFLOW_CTX_DAG_RUN_ID=e831ba7b-6e80-4c0a-ba83-05cfa55cf309 [2021-12-16 10:22:50,798] {kubernetes_pod.py:365} INFO - creating pod with labels {'dag_id': 'openvds_import', 'task_id': 'OPENVDS', 'execution_date': '2021-12-16T102247.0046280000-b0e7abcf2', 'try_number': '1'} and launcher [2021-12-16 10:22:51,178] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:51,178] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:22:52,305] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:52,306] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:22:53,442] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:53,443] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:22:54,571] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:54,571] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:22:55,706] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:55,706] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:22:56,859] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:56,859] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:22:58,016] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:58,016] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:22:59,151] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:22:59,152] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:00,293] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:00,293] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:01,415] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:01,416] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:02,537] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:02,539] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:03,673] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:03,673] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:04,818] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:04,819] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:05,955] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:05,956] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:07,087] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:07,088] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:08,226] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:08,227] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:09,363] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:09,364] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:10,499] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:10,500] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:11,644] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:11,644] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:12,770] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:12,771] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:13,905] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:13,906] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:15,036] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:15,037] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:16,163] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:16,164] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:17,300] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:17,300] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:18,746] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:18,747] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:19,879] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:19,879] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:21,003] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:21,003] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:22,148] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:22,149] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:23,274] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:23,275] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:24,412] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:24,412] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:25,543] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:25,543] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:26,661] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:26,662] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:27,781] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:27,781] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:28,922] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:28,922] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:30,058] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:30,058] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:31,195] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:31,196] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:32,312] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:32,313] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:33,443] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:33,443] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:34,571] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:34,572] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:35,679] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:35,680] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:36,755] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:36,756] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:37,860] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:37,861] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:39,004] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:39,005] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:40,145] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:40,146] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:41,265] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:41,266] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:42,381] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:42,381] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:43,431] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:43,432] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:44,521] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:44,522] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:45,637] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:45,637] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:46,731] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:46,731] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:47,817] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:47,817] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:48,913] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:48,913] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:50,016] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:50,017] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:51,160] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:51,160] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:52,254] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:52,255] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:53,354] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:53,354] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:54,423] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:54,424] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:55,487] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:55,488] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:56,535] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:56,535] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:57,632] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:57,632] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:58,719] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:58,719] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:23:59,812] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:23:59,812] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:00,920] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:00,920] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:02,049] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:02,049] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:03,161] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:03,162] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:04,269] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:04,269] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:05,397] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:05,397] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:06,537] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:06,537] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:07,659] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:07,659] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:08,803] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:08,804] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:09,952] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:09,952] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:11,105] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:11,105] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:12,228] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:12,229] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:13,380] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:13,380] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:14,525] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:14,525] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:15,651] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:15,651] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:16,804] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:16,805] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:17,940] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:17,940] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:19,085] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:19,085] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:20,236] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:20,236] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:21,385] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:21,386] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:22,524] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:22,524] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:23,666] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:23,666] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:24,815] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:24,816] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:25,946] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:25,947] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:27,091] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:27,092] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:28,231] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:28,231] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:29,374] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:29,374] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:30,521] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:30,522] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:32,245] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:32,246] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:33,391] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:33,391] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:34,532] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:34,532] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:35,676] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:35,676] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:36,823] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:36,824] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:37,970] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:37,971] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:39,107] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:39,108] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:40,249] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:40,249] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:41,391] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:41,392] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:42,539] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:42,540] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:43,689] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:43,689] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:44,828] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:44,829] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:45,960] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:45,960] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:47,081] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:47,081] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:48,229] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:48,230] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:49,377] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:49,378] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:50,553] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:50,553] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:51,693] {pod_launcher.py:198} INFO - Event: openvds.f1bb8166bac24b19b9753b92dd152248 had an event of type Pending [2021-12-16 10:24:51,694] {pod_launcher.py:128} WARNING - Pod not yet started: openvds.f1bb8166bac24b19b9753b92dd152248 [2021-12-16 10:24:51,867] {taskinstance.py:1501} ERROR - Task failed with exception Traceback (most recent call last): File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 366, in execute final_state, remote_pod, result = self.create_new_pod_for_operator(labels, launcher) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 519, in create_new_pod_for_operator launcher.start_pod(self.pod, startup_timeout=self.startup_timeout_seconds) File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 329, in wrapped_f return self.call(f, *args, **kw) File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 409, in call do = self.iter(retry_state=retry_state) File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 356, in iter return fut.result() File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 437, in result return self.__get_result() File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result raise self._exception File "/home/airflow/.local/lib/python3.8/site-packages/tenacity/__init__.py", line 412, in call result = fn(*args, **kwargs) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/utils/pod_launcher.py", line 131, in start_pod raise AirflowException("Pod took too long to start") airflow.exceptions.AirflowException: Pod took too long to start During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1157, in _run_raw_task self._prepare_and_execute_task_with_callbacks(context, task) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1331, in _prepare_and_execute_task_with_callbacks result = self._execute_task(context, task_copy) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1361, in _execute_task result = task_copy.execute(context=context) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 373, in execute raise AirflowException(f'Pod Launching failed: {ex}') airflow.exceptions.AirflowException: Pod Launching failed: Pod took too long to start [2021-12-16 10:24:51,873] {taskinstance.py:1544} INFO - Marking task as FAILED. dag_id=openvds_import, task_id=OPENVDS, execution_date=20211216T102247, start_date=20211216T102249, end_date=20211216T102451 [2021-12-16 10:24:51,959] {local_task_job.py:151} INFO - Task exited with return code 1