IBM M15 SEGY to ZGY conversion Issue: ERROR - Event with run id segy-to-zgy.5ae91e92-0354-4bc3-8026-b963e73c7672 Failed
Hello,
I'm trying to run the sgy-to-zgy worflow and I'm getting faillure and I'm not finding where the problem is. I'm using the collection from platform validation. Attached is my complete test: M15_IBM_Segy_to_Zgy_Juliana.txt
And here is the log at Airflow (you will find in the txt also):
*** Log file does not exist: /opt/airflow/logs/sgy-to-zgy/segy-to-zgy/2023-01-10T14:52:33.788939+00:00/1.log
*** Fetching from: http://airflow-worker-0.airflow-worker.osdu.svc.cluster.local:8793/log/sgy-to-zgy/segy-to-zgy/2023-01-10T14:52:33.788939+00:00/1.log
[2023-01-10 14:52:37,552] {taskinstance.py:896} INFO - Dependencies all met for <TaskInstance: sgy-to-zgy.segy-to-zgy 2023-01-10T14:52:33.788939+00:00 [queued]>
[2023-01-10 14:52:37,580] {taskinstance.py:896} INFO - Dependencies all met for <TaskInstance: sgy-to-zgy.segy-to-zgy 2023-01-10T14:52:33.788939+00:00 [queued]>
[2023-01-10 14:52:37,580] {taskinstance.py:1087} INFO -
--------------------------------------------------------------------------------
[2023-01-10 14:52:37,581] {taskinstance.py:1088} INFO - Starting attempt 1 of 1
[2023-01-10 14:52:37,581] {taskinstance.py:1089} INFO -
--------------------------------------------------------------------------------
[2023-01-10 14:52:37,597] {taskinstance.py:1107} INFO - Executing <Task(KubernetesPodOperator): segy-to-zgy> on 2023-01-10T14:52:33.788939+00:00
[2023-01-10 14:52:37,605] {standard_task_runner.py:52} INFO - Started process 2237 to run task
[2023-01-10 14:52:37,619] {standard_task_runner.py:76} INFO - Running: ['***', 'tasks', 'run', 'sgy-to-zgy', 'segy-to-zgy', '2023-01-10T14:52:33.788939+00:00', '--job-id', '15662', '--pool', 'default_pool', '--raw', '--subdir', 'DAGS_FOLDER/segy_to_zgy_ingestion_dag.py', '--cfg-path', '/tmp/tmp3ps28t03', '--error-file', '/tmp/tmp4u0uwuna']
[2023-01-10 14:52:37,620] {standard_task_runner.py:77} INFO - Job 15662: Subtask segy-to-zgy
[2023-01-10 14:52:37,717] {logging_mixin.py:104} INFO - Running <TaskInstance: sgy-to-zgy.segy-to-zgy 2023-01-10T14:52:33.788939+00:00 [running]> on host ***-worker-0.***-worker.osdu.svc.cluster.local
[2023-01-10 14:52:37,866] {taskinstance.py:1300} INFO - Exporting the following env vars:
AIRFLOW_CTX_DAG_OWNER=***
AIRFLOW_CTX_DAG_ID=sgy-to-zgy
AIRFLOW_CTX_TASK_ID=segy-to-zgy
AIRFLOW_CTX_EXECUTION_DATE=2023-01-10T14:52:33.788939+00:00
AIRFLOW_CTX_DAG_RUN_ID=5ae91e92-0354-4bc3-8026-b963e73c7672
[2023-01-10 14:52:38,024] {kubernetes_pod.py:365} INFO - creating pod with labels {'dag_id': 'sgy-to-zgy', 'task_id': 'segy-to-zgy', 'execution_date': '2023-01-10T145233.7889390000-87f81d4fa', 'try_number': '1'} and launcher <airflow.providers.cncf.kubernetes.utils.pod_launcher.PodLauncher object at 0x7fbdb6e60940>
[2023-01-10 14:52:38,190] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Pending
[2023-01-10 14:52:38,190] {pod_launcher.py:128} WARNING - Pod not yet started: segy-to-zgy.ea9abe38880c42f4b4544b3488863711
[2023-01-10 14:52:39,221] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Pending
[2023-01-10 14:52:39,222] {pod_launcher.py:128} WARNING - Pod not yet started: segy-to-zgy.ea9abe38880c42f4b4544b3488863711
[2023-01-10 14:52:40,248] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Pending
[2023-01-10 14:52:40,249] {pod_launcher.py:128} WARNING - Pod not yet started: segy-to-zgy.ea9abe38880c42f4b4544b3488863711
[2023-01-10 14:52:41,278] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Pending
[2023-01-10 14:52:41,278] {pod_launcher.py:128} WARNING - Pod not yet started: segy-to-zgy.ea9abe38880c42f4b4544b3488863711
[2023-01-10 14:52:42,304] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Running
[2023-01-10 14:52:42,412] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.518421573-06:00 0.0000792023-01-10T08:52:40.518489974-06:00 ] 2023-01-10T08:52:40.518517391-06:00
[2023-01-10 14:52:42,413] {pod_launcher.py:149} INFO - Application: SEGY-TO-ZGY Converter
[2023-01-10 14:52:42,414] {pod_launcher.py:149} INFO - Version: 0.0.0.0
[2023-01-10 14:52:42,414] {pod_launcher.py:149} INFO - Build date: Dec 15 2022 17:22:25
[2023-01-10 14:52:42,415] {pod_launcher.py:149} INFO - Copyright: (c) 2021-2022 Schlumberger
[2023-01-10 14:52:42,415] {pod_launcher.py:149} INFO -
[2023-01-10 14:52:42,415] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.518675835-06:00 0.0005452023-01-10T08:52:40.518698430-06:00 ] 2023-01-10T08:52:40.518720688-06:00 Current working directory: /2023-01-10T08:52:40.518743359-06:00
[2023-01-10 14:52:42,416] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.518794822-06:00 0.0006702023-01-10T08:52:40.518816894-06:00 ] 2023-01-10T08:52:40.518841022-06:00 Init2023-01-10T08:52:40.518871141-06:00
[2023-01-10 14:52:42,416] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.518948445-06:00 0.0008082023-01-10T08:52:40.518971238-06:00 ] 2023-01-10T08:52:40.518993244-06:00 Environment variables:2023-01-10T08:52:40.519015180-06:00
[2023-01-10 14:52:42,417] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519066822-06:00 0.0009422023-01-10T08:52:40.519089023-06:00 ] 2023-01-10T08:52:40.519111102-06:00 SEGYTOZGY_GENERATE_INDEX=[1]2023-01-10T08:52:40.519133263-06:00
[2023-01-10 14:52:42,417] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519183263-06:00 0.0010592023-01-10T08:52:40.519205469-06:00 ] 2023-01-10T08:52:40.519227643-06:00 SEGYTOZGY_INSECURE_PRINT_TOKEN=[]2023-01-10T08:52:40.519250233-06:00
[2023-01-10 14:52:42,418] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519302509-06:00 0.0011782023-01-10T08:52:40.519321730-06:00 ] 2023-01-10T08:52:40.519344198-06:00 SEGYTOZGY_VERBOSITY=[3]2023-01-10T08:52:40.519367118-06:00
[2023-01-10 14:52:42,418] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519416239-06:00 0.0012922023-01-10T08:52:40.519438220-06:00 ] 2023-01-10T08:52:40.519508950-06:00 TOKEN_SVC_URL=[]2023-01-10T08:52:40.519529190-06:00
[2023-01-10 14:52:42,419] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519579838-06:00 0.0014542023-01-10T08:52:40.519601918-06:00 ] 2023-01-10T08:52:40.519623822-06:00 TOKEN_EXPIRATION_THRESHOLD_SECONDS=[]2023-01-10T08:52:40.519645685-06:00
[2023-01-10 14:52:42,419] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519715725-06:00 0.0015782023-01-10T08:52:40.519746884-06:00 ] 2023-01-10T08:52:40.519769516-06:00 SD_SVC_URL=[http://os-seismic-store-service:8080/api/v3]2023-01-10T08:52:40.519791591-06:00
[2023-01-10 14:52:42,419] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519841409-06:00 0.0017162023-01-10T08:52:40.519863604-06:00 ] 2023-01-10T08:52:40.519885492-06:00 SD_SVC_API_KEY=[ok]2023-01-10T08:52:40.519907487-06:00
[2023-01-10 14:52:42,420] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.519956694-06:00 0.0018322023-01-10T08:52:40.519978440-06:00 ] 2023-01-10T08:52:40.520000519-06:00 SD_SVC_SCOPE=[]2023-01-10T08:52:40.520024610-06:00
[2023-01-10 14:52:42,420] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520071260-06:00 0.0019472023-01-10T08:52:40.520093182-06:00 ] 2023-01-10T08:52:40.520115119-06:00 SD_READ_CACHE_PAGE_SIZE=[4195024]2023-01-10T08:52:40.520137693-06:00
[2023-01-10 14:52:42,420] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520186519-06:00 0.0020612023-01-10T08:52:40.520208520-06:00 ] 2023-01-10T08:52:40.520230606-06:00 SD_READ_CACHE_MAX_PAGES=[256]2023-01-10T08:52:40.520252578-06:00
[2023-01-10 14:52:42,432] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520301227-06:00 0.0021772023-01-10T08:52:40.520329699-06:00 ] 2023-01-10T08:52:40.520351964-06:00 SD_READ_CACHE_BLOCKS_PER_PAGE=[]2023-01-10T08:52:40.520373889-06:00
[2023-01-10 14:52:42,433] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520423072-06:00 0.0022982023-01-10T08:52:40.520445789-06:00 ] 2023-01-10T08:52:40.520517937-06:00 STORAGE_SVC_URL=[http://os-storage-ibm:8080/api/storage/v2/]2023-01-10T08:52:40.520536747-06:00
[2023-01-10 14:52:42,434] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520586844-06:00 0.0024622023-01-10T08:52:40.520609625-06:00 ] 2023-01-10T08:52:40.520632668-06:00 STORAGE_SVC_SCOPE=[]2023-01-10T08:52:40.520655076-06:00
[2023-01-10 14:52:42,434] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520704619-06:00 0.0025792023-01-10T08:52:40.520727325-06:00 ] 2023-01-10T08:52:40.520749743-06:00 OSDU_DATAPARTITIONID=[opendes]2023-01-10T08:52:40.520774280-06:00
[2023-01-10 14:52:42,435] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520845578-06:00 0.0027022023-01-10T08:52:40.520873547-06:00 ] 2023-01-10T08:52:40.520900776-06:00 SEGYTOZGY_OUTPUT_PATH=[]2023-01-10T08:52:40.520927670-06:00
[2023-01-10 14:52:42,436] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.520988040-06:00 0.0028562023-01-10T08:52:40.521015401-06:00 ] 2023-01-10T08:52:40.521042378-06:00 SEGYTOZGY_OUTPUT_BRICK_SIZE=[]2023-01-10T08:52:40.521069081-06:00
[2023-01-10 14:52:42,436] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.521127848-06:00 0.0029972023-01-10T08:52:40.521154234-06:00 ] 2023-01-10T08:52:40.521180613-06:00 SEGYTOZGY_ZFP_COMPRESS=[]2023-01-10T08:52:40.521207407-06:00
[2023-01-10 14:52:42,437] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.521271095-06:00 0.0031362023-01-10T08:52:40.521299516-06:00 ] 2023-01-10T08:52:40.521328226-06:00 SEGYTOZGY_ZFP_SNR=[]2023-01-10T08:52:40.521358470-06:00
[2023-01-10 14:52:42,437] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.521420386-06:00 0.0032862023-01-10T08:52:40.521488332-06:00 ] 2023-01-10T08:52:40.521519792-06:00 SEGYTOZGY_ZFP_LOD_COMPRESS=[]2023-01-10T08:52:40.521547251-06:00
[2023-01-10 14:52:42,438] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.521608756-06:00 0.0034762023-01-10T08:52:40.521636201-06:00 ] 2023-01-10T08:52:40.521662389-06:00 SEGYTOZGY_ZFP_LOD_SNR=[]2023-01-10T08:52:40.521688115-06:00
[2023-01-10 14:52:42,439] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.521751851-06:00 0.0036152023-01-10T08:52:40.521778437-06:00 ] 2023-01-10T08:52:40.521808381-06:00 SEGYTOZGY_ZGY_Output_Parameters=[]2023-01-10T08:52:40.521838355-06:00
[2023-01-10 14:52:42,439] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.521906577-06:00 0.0037722023-01-10T08:52:40.521938069-06:00 ] 2023-01-10T08:52:40.521967207-06:00 set SEGYTOZGY_INSECURE_PRINT_TOKEN=1 to print secret values2023-01-10T08:52:40.521997323-06:00
[2023-01-10 14:52:42,440] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.522060621-06:00 0.0039262023-01-10T08:52:40.522091151-06:00 ] 2023-01-10T08:52:40.522123395-06:00 END Environment variables2023-01-10T08:52:40.522153981-06:00
[2023-01-10 14:52:42,441] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.522224855-06:00 0.0040902023-01-10T08:52:40.522256541-06:00 ] 2023-01-10T08:52:40.522287720-06:00 Command line arguments: [/usr/local/bin/segy/SegyToZgy] [--osdu] [opendes:dataset--FileCollection.SEGY:660362:] [opendes:work-product--WorkProduct:660362:]2023-01-10T08:52:40.522318188-06:00
[2023-01-10 14:52:42,442] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.522415266-06:00 0.0042762023-01-10T08:52:40.522446309-06:00 ] 2023-01-10T08:52:40.522515128-06:00 In SegyToZgy useOrGetToken ...2023-01-10T08:52:40.522546641-06:00
[2023-01-10 14:52:42,442] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.522626309-06:00 0.0044872023-01-10T08:52:40.522656000-06:00 ] 2023-01-10T08:52:40.522689167-06:00 Using TOKEN for Seismic DMS service.2023-01-10T08:52:40.522718636-06:00
[2023-01-10 14:52:42,443] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.522797923-06:00 0.0046622023-01-10T08:52:40.522827408-06:00 ] 2023-01-10T08:52:40.522855243-06:00 In SegyToZgy useOrGetToken ...2023-01-10T08:52:40.522884098-06:00
[2023-01-10 14:52:42,443] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.522954580-06:00 0.0048132023-01-10T08:52:40.522985688-06:00 ] 2023-01-10T08:52:40.523012692-06:00 Using TOKEN for Storage service.2023-01-10T08:52:40.523045814-06:00
[2023-01-10 14:52:42,444] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.523128258-06:00 0.0050002023-01-10T08:52:40.523150508-06:00 ] 2023-01-10T08:52:40.523172610-06:00 Fetching work product [opendes:work-product--WorkProduct:660362:]2023-01-10T08:52:40.523194752-06:00
[2023-01-10 14:52:42,444] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.523264581-06:00 0.0051392023-01-10T08:52:40.523286776-06:00 ] 2023-01-10T08:52:40.523308777-06:00 About to get record [opendes:work-product--WorkProduct:660362:]2023-01-10T08:52:40.523330660-06:00
[2023-01-10 14:52:42,446] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.523379166-06:00 0.0052552023-01-10T08:52:40.523401516-06:00 ] 2023-01-10T08:52:40.523423873-06:00 Storage service URL: [http://os-storage-ibm:8080/api/storage/v2/]2023-01-10T08:52:40.523446838-06:00
[2023-01-10 14:52:42,447] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.523540542-06:00 0.0054142023-01-10T08:52:40.523563109-06:00 ] 2023-01-10T08:52:40.523585283-06:00 Data partition ID : [opendes]2023-01-10T08:52:40.523607685-06:00
[2023-01-10 14:52:42,447] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.523669201-06:00 0.0055442023-01-10T08:52:40.523691477-06:00 ] 2023-01-10T08:52:40.523713471-06:00 About to get record [opendes:work-product--WorkProduct:660362:] version 184467440737095516152023-01-10T08:52:40.523735518-06:00
[2023-01-10 14:52:42,448] {pod_launcher.py:149} INFO - [2023-01-10T08:52:40.523835829-06:00 0.0057102023-01-10T08:52:40.523857918-06:00 ] 2023-01-10T08:52:40.523880102-06:00 GET [http://os-storage-ibm:8080/api/storage/v2/records/opendes%3Awork-product--WorkProduct%3A660362]2023-01-10T08:52:40.523902254-06:00
[2023-01-10 14:52:42,448] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.507208521-06:00 0.9888462023-01-10T08:52:41.507314539-06:00 ] 2023-01-10T08:52:41.507411565-06:00 Status code 2002023-01-10T08:52:41.507579367-06:00
[2023-01-10 14:52:42,449] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.508214132-06:00 0.9899572023-01-10T08:52:41.508303758-06:00 ] 2023-01-10T08:52:41.508393082-06:00 Got 7706 chars of content2023-01-10T08:52:41.508542349-06:00
[2023-01-10 14:52:42,449] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.510626150-06:00 0.9922692023-01-10T08:52:41.510721320-06:00 ] 2023-01-10T08:52:41.510809115-06:00 Fetching work product component [opendes:work-product-component--SeismicTraceData:660362:]2023-01-10T08:52:41.510899424-06:00
[2023-01-10 14:52:42,450] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.511134532-06:00 0.9929092023-01-10T08:52:41.511225170-06:00 ] 2023-01-10T08:52:41.511312794-06:00 About to get record [opendes:work-product-component--SeismicTraceData:660362:]2023-01-10T08:52:41.511400534-06:00
[2023-01-10 14:52:42,450] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.511667256-06:00 0.9934372023-01-10T08:52:41.511758986-06:00 ] 2023-01-10T08:52:41.511843181-06:00 Storage service URL: [http://os-storage-ibm:8080/api/storage/v2/]2023-01-10T08:52:41.511954203-06:00
[2023-01-10 14:52:42,450] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.512196904-06:00 0.9939252023-01-10T08:52:41.512346032-06:00 ] 2023-01-10T08:52:41.512442260-06:00 Data partition ID : [opendes]2023-01-10T08:52:41.512592276-06:00
[2023-01-10 14:52:42,451] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.512805174-06:00 0.9945762023-01-10T08:52:41.512892955-06:00 ] 2023-01-10T08:52:41.512980122-06:00 About to get record [opendes:work-product-component--SeismicTraceData:660362:] version 184467440737095516152023-01-10T08:52:41.513068519-06:00
[2023-01-10 14:52:42,451] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.513426548-06:00 0.9950912023-01-10T08:52:41.513598238-06:00 ] 2023-01-10T08:52:41.513690800-06:00 GET [http://os-storage-ibm:8080/api/storage/v2/records/opendes%3Awork-product-component--SeismicTraceData%3A660362]2023-01-10T08:52:41.513777660-06:00
[2023-01-10 14:52:42,451] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.896570372-06:00 1.3781842023-01-10T08:52:41.896663847-06:00 ] 2023-01-10T08:52:41.896759821-06:00 Status code 2002023-01-10T08:52:41.896871307-06:00
[2023-01-10 14:52:42,452] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.897382040-06:00 1.3791652023-01-10T08:52:41.897497738-06:00 ] 2023-01-10T08:52:41.897566034-06:00 Got 9344 chars of content2023-01-10T08:52:41.897648659-06:00
[2023-01-10 14:52:42,452] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.898877484-06:00 1.3806382023-01-10T08:52:41.898948843-06:00 ] 2023-01-10T08:52:41.899018062-06:00 Work product component [opendes:work-product-component--SeismicTraceData:660362:] kind: [osdu:osdu:work-product-component--SeismicTraceData:1.0.0]2023-01-10T08:52:41.899087778-06:00
[2023-01-10 14:52:42,452] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.899356532-06:00 1.3811562023-01-10T08:52:41.899425775-06:00 ] 2023-01-10T08:52:41.899536489-06:00 Seismic trace data ID: [opendes:work-product-component--SeismicTraceData:660362]2023-01-10T08:52:41.899608258-06:00
[2023-01-10 14:52:42,453] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.899764424-06:00 1.3815672023-01-10T08:52:41.899834789-06:00 ] 2023-01-10T08:52:41.899903912-06:00 Using bin grid ID: [opendes:work-product-component--SeismicBinGrid:660362:] from seismic trace data2023-01-10T08:52:41.899970298-06:00
[2023-01-10 14:52:42,453] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.900349569-06:00 1.3821492023-01-10T08:52:41.900418104-06:00 ] 2023-01-10T08:52:41.900528965-06:00 About to get record [opendes:dataset--FileCollection.SEGY:660362:]2023-01-10T08:52:41.900600791-06:00
[2023-01-10 14:52:42,453] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.900753396-06:00 1.3825562023-01-10T08:52:41.900823752-06:00 ] 2023-01-10T08:52:41.900889952-06:00 Storage service URL: [http://os-storage-ibm:8080/api/storage/v2/]2023-01-10T08:52:41.900958890-06:00
[2023-01-10 14:52:42,454] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.901108240-06:00 1.3829132023-01-10T08:52:41.901177258-06:00 ] 2023-01-10T08:52:41.901247209-06:00 Data partition ID : [opendes]2023-01-10T08:52:41.901315755-06:00
[2023-01-10 14:52:42,454] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.901511102-06:00 1.3832752023-01-10T08:52:41.901582036-06:00 ] 2023-01-10T08:52:41.901650408-06:00 About to get record [opendes:dataset--FileCollection.SEGY:660362:] version 184467440737095516152023-01-10T08:52:41.901721601-06:00
[2023-01-10 14:52:42,454] {pod_launcher.py:149} INFO - [2023-01-10T08:52:41.901905413-06:00 1.3837082023-01-10T08:52:41.901973301-06:00 ] 2023-01-10T08:52:41.902041625-06:00 GET [http://os-storage-ibm:8080/api/storage/v2/records/opendes%3Adataset--FileCollection.SEGY%3A660362]2023-01-10T08:52:41.902129709-06:00
[2023-01-10 14:52:42,454] {pod_launcher.py:149} INFO - [1.796632] Status code 200
[2023-01-10 14:52:42,455] {pod_launcher.py:149} INFO - [1.797039] Got 2836 chars of content
[2023-01-10 14:52:42,455] {pod_launcher.py:149} INFO - [1.797618] About to get record [opendes:work-product-component--SeismicBinGrid:660362:]
[2023-01-10 14:52:42,455] {pod_launcher.py:149} INFO - [1.797678] Storage service URL: [http://os-storage-ibm:8080/api/storage/v2/]
[2023-01-10 14:52:42,455] {pod_launcher.py:149} INFO - [1.7977142023-01-10T08:52:42.315887127-06:00 ] Data partition ID : [opendes]
[2023-01-10 14:52:42,455] {pod_launcher.py:149} INFO - [1.797758] About to get record [opendes:work-product-component--SeismicBinGrid:660362:] version 18446744073709551615
[2023-01-10 14:52:42,456] {pod_launcher.py:149} INFO - [1.797841] GET [http://os-storage-ibm:8080/api/storage/v2/records/opendes%3Awork-product-component--SeismicBinGrid%3A660362]
[2023-01-10 14:52:42,742] {pod_launcher.py:149} INFO - [2.216907] Status code 200
[2023-01-10 14:52:42,743] {pod_launcher.py:149} INFO - [2.217159] 2023-01-10T08:52:42.735331037-06:00 Got 3811 chars of content
[2023-01-10 14:52:42,743] {pod_launcher.py:149} INFO - [2.217481] Run ID: 00d8a336-91b6-4e70-80e4-f4f59b0a277f
[2023-01-10 14:52:42,744] {pod_launcher.py:149} INFO - [2.218158] Parsed options
[2023-01-10 14:52:42,744] {pod_launcher.py:149} INFO - [2.218522] Read 2837 chars of SEG-Y config JSON
[2023-01-10 14:52:42,744] {pod_launcher.py:149} INFO - getSegyContextFromParameterString: Not a WKS OSDU FileCollection.SEGY parameter file
[2023-01-10 14:52:44,808] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Running
[2023-01-10 14:52:44,808] {pod_launcher.py:171} INFO - Pod segy-to-zgy.ea9abe38880c42f4b4544b3488863711 has state running
[2023-01-10 14:52:46,845] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Failed
[2023-01-10 14:52:46,846] {pod_launcher.py:308} ERROR - Event with job id segy-to-zgy.ea9abe38880c42f4b4544b3488863711 Failed
[2023-01-10 14:52:46,869] {pod_launcher.py:198} INFO - Event: segy-to-zgy.ea9abe38880c42f4b4544b3488863711 had an event of type Failed
[2023-01-10 14:52:46,869] {pod_launcher.py:308} ERROR - Event with job id segy-to-zgy.ea9abe38880c42f4b4544b3488863711 Failed
[2023-01-10 14:52:46,968] {taskinstance.py:1501} ERROR - Task failed with exception
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 368, in execute
raise AirflowException(f'Pod {self.pod.metadata.name} returned a failure: {remote_pod}')
airflow.exceptions.AirflowException: Pod segy-to-zgy.ea9abe38880c42f4b4544b3488863711 returned a failure: {'api_version': 'v1',
'kind': 'Pod',
'metadata': {'annotations': {'cni.projectcalico.org/containerID': '08dfa478236098077857ae0f258ec47285641ee5fb0bb8ff7794e90490f28d40',
'cni.projectcalico.org/podIP': '',
'cni.projectcalico.org/podIPs': '',
'k8s.v1.cni.cncf.io/network-status': '[{\n'
' '
'"name": '
'"k8s-pod-network",\n'
' "ips": '
'[\n'
' '
'"172.30.227.142"\n'
' ],\n'
' '
'"default": '
'true,\n'
' "dns": '
'{}\n'
'}]',
'k8s.v1.cni.cncf.io/networks-status': '[{\n'
' '
'"name": '
'"k8s-pod-network",\n'
' '
'"ips": [\n'
' '
'"172.30.227.142"\n'
' ],\n'
' '
'"default": '
'true,\n'
' '
'"dns": '
'{}\n'
'}]',
'openshift.io/scc': 'anyuid'},
'cluster_name': None,
'creation_timestamp': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal()),
'deletion_grace_period_seconds': None,
'deletion_timestamp': None,
'finalizers': None,
'generate_name': None,
'generation': None,
'initializers': None,
'labels': {'airflow_version': '2.1.1',
'dag_id': 'sgy-to-zgy',
'execution_date': '2023-01-10T145233.7889390000-87f81d4fa',
'kubernetes_pod_operator': 'True',
'task_id': 'segy-to-zgy',
'try_number': '1'},
'managed_fields': [{'api_version': 'v1',
'fields': None,
'manager': 'OpenAPI-Generator',
'operation': 'Update',
'time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal())},
{'api_version': 'v1',
'fields': None,
'manager': 'multus',
'operation': 'Update',
'time': datetime.datetime(2023, 1, 10, 14, 52, 39, tzinfo=tzlocal())},
{'api_version': 'v1',
'fields': None,
'manager': 'Go-http-client',
'operation': 'Update',
'time': datetime.datetime(2023, 1, 10, 14, 52, 43, tzinfo=tzlocal())}],
'name': 'segy-to-zgy.ea9abe38880c42f4b4544b3488863711',
'namespace': 'osdu',
'owner_references': None,
'resource_version': '121815072',
'self_link': None,
'uid': '874be3d5-7bfc-4e44-af80-43c761c9b35e'},
'spec': {'active_deadline_seconds': None,
'affinity': {'node_affinity': None,
'pod_affinity': None,
'pod_anti_affinity': None},
'automount_service_account_token': None,
'containers': [{'args': ['--osdu',
'opendes:dataset--FileCollection.SEGY:660362:',
'opendes:work-product--WorkProduct:660362:'],
'command': None,
'env': [{'name': 'STORAGE_SVC_URL',
'value': 'http://os-storage-ibm:8080/api/storage/v2/',
'value_from': None},
{'name': 'SD_SVC_URL',
'value': 'http://os-seismic-store-service:8080/api/v3',
'value_from': None},
{'name': 'SD_SVC_TOKEN',
'value': 'Bearer '
'eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJsTFluRU1KUlBfOVBWeVdTdmZkdlNva2VmUlEtQ0k2dE5TbGpOZjh4VDlvIn0.eyJleHAiOjE2NzMzODI4OTcsImlhdCI6MTY3MzM2MTI5NywianRpIjoiZDMyNTE0YmEtZmUxNy00OTdjLWEzODUtNGE4NGM1MzVmYjVhIiwiaXNzIjoiaHR0cHM6Ly9rZXljbG9hay1vc2R1Lm9kaS1vZy1vc2R1LWJhOGUzOGQ0YzAxMWQ2MjczNzlhZjFhNDI4MGM0ZTM1LTAwMDAudXMtc291dGguY29udGFpbmVycy5hcHBkb21haW4uY2xvdWQvYXV0aC9yZWFsbXMvT1NEVSIsInN1YiI6IjZlMmIxMDFjLWIyMjMtNDYwNi05YzMxLWVhZDg0YzBhMDVlMCIsInR5cCI6IkJlYXJlciIsImF6cCI6Im9zZHUtbG9naW4iLCJzZXNzaW9uX3N0YXRlIjoiYzdmZTlhNTktZGYxMC00ZWQ2LTkxYTMtNTlhZWM2YjhiOWJiIiwiYWNyIjoiMSIsInJlYWxtX2FjY2VzcyI6eyJyb2xlcyI6WyJkZWZhdWx0LXJvbGVzLW9zZHUiXX0sInNjb3BlIjoib3BlbmlkIHByb2ZpbGUgZW1haWwiLCJzaWQiOiJjN2ZlOWE1OS1kZjEwLTRlZDYtOTFhMy01OWFlYzZiOGI5YmIiLCJlbWFpbF92ZXJpZmllZCI6ZmFsc2UsIm5hbWUiOiJwcmVzaGlwdGVhbWEgb3Blbmdyb3VwIiwicHJlZmVycmVkX3VzZXJuYW1lIjoicHJlc2hpcHRlYW1hIiwiZ2l2ZW5fbmFtZSI6InByZXNoaXB0ZWFtYSIsImZhbWlseV9uYW1lIjoib3Blbmdyb3VwIiwiZW1haWwiOiJwcmVzaGlwdGVhbWFAb3NkdS5vcGVuZ3JvdXAub3JnIn0.UcmWMYp-M9eDsvg4zaFgfMFyaDbd-bKJ9g7i6PRovHULi06UVomooYj_wPuoysbI3880X51iaU6gsBSc8iTUzFhsopOmw8Nm_PgJtJ79p3XDauTVd1mOBKsRLqlqLciTK26KLelu9bs7R2VlNqP-qXAFtWu-p4ExlS3LvkVXI0l3t7IGV4LD4-8VDBK3_5iMAIPswf5moB137GVJhDtsnIWL5TGV-j0a9CwriS35ZK_DRz_4BIOe5C_zua6mDCh1jqwtKUnkcK1YLYaDE3T-SwiFDZqFW5Ev7ZK8MFqTVCwrp1a9PLqXhBFBqWIzFdX0rVskdusXWq0lnyCC9kvG1w',
'value_from': None},
{'name': 'SPATIALREF_SVC_TOKEN',
'value': 'authorization',
'value_from': None},
{'name': 'STORAGE_SVC_TOKEN',
'value': 'Bearer '
'eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJsTFluRU1KUlBfOVBWeVdTdmZkdlNva2VmUlEtQ0k2dE5TbGpOZjh4VDlvIn0.eyJleHAiOjE2NzMzODI4OTcsImlhdCI6MTY3MzM2MTI5NywianRpIjoiZDMyNTE0YmEtZmUxNy00OTdjLWEzODUtNGE4NGM1MzVmYjVhIiwiaXNzIjoiaHR0cHM6Ly9rZXljbG9hay1vc2R1Lm9kaS1vZy1vc2R1LWJhOGUzOGQ0YzAxMWQ2MjczNzlhZjFhNDI4MGM0ZTM1LTAwMDAudXMtc291dGguY29udGFpbmVycy5hcHBkb21haW4uY2xvdWQvYXV0aC9yZWFsbXMvT1NEVSIsInN1YiI6IjZlMmIxMDFjLWIyMjMtNDYwNi05YzMxLWVhZDg0YzBhMDVlMCIsInR5cCI6IkJlYXJlciIsImF6cCI6Im9zZHUtbG9naW4iLCJzZXNzaW9uX3N0YXRlIjoiYzdmZTlhNTktZGYxMC00ZWQ2LTkxYTMtNTlhZWM2YjhiOWJiIiwiYWNyIjoiMSIsInJlYWxtX2FjY2VzcyI6eyJyb2xlcyI6WyJkZWZhdWx0LXJvbGVzLW9zZHUiXX0sInNjb3BlIjoib3BlbmlkIHByb2ZpbGUgZW1haWwiLCJzaWQiOiJjN2ZlOWE1OS1kZjEwLTRlZDYtOTFhMy01OWFlYzZiOGI5YmIiLCJlbWFpbF92ZXJpZmllZCI6ZmFsc2UsIm5hbWUiOiJwcmVzaGlwdGVhbWEgb3Blbmdyb3VwIiwicHJlZmVycmVkX3VzZXJuYW1lIjoicHJlc2hpcHRlYW1hIiwiZ2l2ZW5fbmFtZSI6InByZXNoaXB0ZWFtYSIsImZhbWlseV9uYW1lIjoib3Blbmdyb3VwIiwiZW1haWwiOiJwcmVzaGlwdGVhbWFAb3NkdS5vcGVuZ3JvdXAub3JnIn0.UcmWMYp-M9eDsvg4zaFgfMFyaDbd-bKJ9g7i6PRovHULi06UVomooYj_wPuoysbI3880X51iaU6gsBSc8iTUzFhsopOmw8Nm_PgJtJ79p3XDauTVd1mOBKsRLqlqLciTK26KLelu9bs7R2VlNqP-qXAFtWu-p4ExlS3LvkVXI0l3t7IGV4LD4-8VDBK3_5iMAIPswf5moB137GVJhDtsnIWL5TGV-j0a9CwriS35ZK_DRz_4BIOe5C_zua6mDCh1jqwtKUnkcK1YLYaDE3T-SwiFDZqFW5Ev7ZK8MFqTVCwrp1a9PLqXhBFBqWIzFdX0rVskdusXWq0lnyCC9kvG1w',
'value_from': None},
{'name': 'STORAGE_SVC_API_KEY',
'value': None,
'value_from': None},
{'name': 'SD_SVC_API_KEY',
'value': 'ok',
'value_from': None},
{'name': 'OSDU_DATAPARTITIONID',
'value': 'opendes',
'value_from': None},
{'name': 'SD_READ_CACHE_PAGE_SIZE',
'value': '4195024',
'value_from': None},
{'name': 'SD_READ_CACHE_MAX_PAGES',
'value': '256',
'value_from': None},
{'name': 'SEGYTOZGY_VERBOSITY',
'value': '3',
'value_from': None},
{'name': 'SEGYTOZGY_GENERATE_INDEX',
'value': '1',
'value_from': None},
{'name': 'IBM_COS_URL',
'value': 'minio-osdu.odi-og-osdu-ba8e38d4c011d627379af1a4280c4e35-0000.us-south.containers.appdomain.cloud',
'value_from': None}],
'env_from': None,
'image': 'community.opengroup.org:5555/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/segy-to-zgy-conversion-v0-18-1:4853f21ab06b5b65b1bafc82b0869583e279cbaf',
'image_pull_policy': 'IfNotPresent',
'lifecycle': None,
'liveness_probe': None,
'name': 'base',
'ports': None,
'readiness_probe': None,
'resources': {'limits': None, 'requests': None},
'security_context': {'allow_privilege_escalation': None,
'capabilities': {'add': None,
'drop': ['MKNOD']},
'privileged': None,
'proc_mount': None,
'read_only_root_filesystem': None,
'run_as_group': None,
'run_as_non_root': None,
'run_as_user': None,
'se_linux_options': None,
'windows_options': None},
'stdin': None,
'stdin_once': None,
'termination_message_path': '/dev/termination-log',
'termination_message_policy': 'File',
'tty': None,
'volume_devices': None,
'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
'mount_propagation': None,
'name': 'kube-api-access-vjxws',
'read_only': True,
'sub_path': None,
'sub_path_expr': None}],
'working_dir': None}],
'dns_config': None,
'dns_policy': 'ClusterFirst',
'enable_service_links': True,
'host_aliases': None,
'host_ipc': None,
'host_network': None,
'host_pid': None,
'hostname': None,
'image_pull_secrets': [{'name': 'docker-pull-hyc-idp-docker-local-artifactory-swg-devops-com-base-registry'},
{'name': 'docker-pull-hyc-idp-docker-local-artifactory-swg-devops-com-anotherbase-registry'},
{'name': 'docker-pull-hyc-idp-docker-local-artifactory-swg-devops-com-base-registry-registry'},
{'name': 'default-dockercfg-86tkd'}],
'init_containers': None,
'node_name': '10.221.213.108',
'node_selector': None,
'preemption_policy': 'PreemptLowerPriority',
'priority': 0,
'priority_class_name': None,
'readiness_gates': None,
'restart_policy': 'Never',
'runtime_class_name': None,
'scheduler_name': 'default-scheduler',
'security_context': {'fs_group': None,
'run_as_group': None,
'run_as_non_root': None,
'run_as_user': None,
'se_linux_options': {'level': 's0:c25,c20',
'role': None,
'type': None,
'user': None},
'supplemental_groups': None,
'sysctls': None,
'windows_options': None},
'service_account': 'default',
'service_account_name': 'default',
'share_process_namespace': None,
'subdomain': None,
'termination_grace_period_seconds': 30,
'tolerations': [{'effect': 'NoExecute',
'key': 'node.kubernetes.io/not-ready',
'operator': 'Exists',
'toleration_seconds': 300,
'value': None},
{'effect': 'NoExecute',
'key': 'node.kubernetes.io/unreachable',
'operator': 'Exists',
'toleration_seconds': 300,
'value': None}],
'volumes': [{'aws_elastic_block_store': None,
'azure_disk': None,
'azure_file': None,
'cephfs': None,
'cinder': None,
'config_map': None,
'csi': None,
'downward_api': None,
'empty_dir': None,
'fc': None,
'flex_volume': None,
'flocker': None,
'gce_persistent_disk': None,
'git_repo': None,
'glusterfs': None,
'host_path': None,
'iscsi': None,
'name': 'kube-api-access-vjxws',
'nfs': None,
'persistent_volume_claim': None,
'photon_persistent_disk': None,
'portworx_volume': None,
'projected': {'default_mode': 420,
'sources': [{'config_map': None,
'downward_api': None,
'secret': None,
'service_account_token': {'audience': None,
'expiration_seconds': 3607,
'path': 'token'}},
{'config_map': {'items': [{'key': 'ca.crt',
'mode': None,
'path': 'ca.crt'}],
'name': 'kube-root-ca.crt',
'optional': None},
'downward_api': None,
'secret': None,
'service_account_token': None},
{'config_map': None,
'downward_api': {'items': [{'field_ref': {'api_version': 'v1',
'field_path': 'metadata.namespace'},
'mode': None,
'path': 'namespace',
'resource_field_ref': None}]},
'secret': None,
'service_account_token': None},
{'config_map': {'items': [{'key': 'service-ca.crt',
'mode': None,
'path': 'service-ca.crt'}],
'name': 'openshift-service-ca.crt',
'optional': None},
'downward_api': None,
'secret': None,
'service_account_token': None}]},
'quobyte': None,
'rbd': None,
'scale_io': None,
'secret': None,
'storageos': None,
'vsphere_volume': None}]},
'status': {'conditions': [{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal()),
'message': None,
'reason': None,
'status': 'True',
'type': 'Initialized'},
{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 43, tzinfo=tzlocal()),
'message': 'containers with unready status: [base]',
'reason': 'ContainersNotReady',
'status': 'False',
'type': 'Ready'},
{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 43, tzinfo=tzlocal()),
'message': 'containers with unready status: [base]',
'reason': 'ContainersNotReady',
'status': 'False',
'type': 'ContainersReady'},
{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal()),
'message': None,
'reason': None,
'status': 'True',
'type': 'PodScheduled'}],
'container_statuses': [{'container_id': 'cri-o://8d0765e9f10aa65f244386db6792e7667b2b287c2b513bb85990c3fc27390520',
'image': 'community.opengroup.org:5555/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/segy-to-zgy-conversion-v0-18-1:4853f21ab06b5b65b1bafc82b0869583e279cbaf',
'image_id': 'community.opengroup.org:5555/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/segy-to-zgy-conversion-v0-18-1@sha256:1a0e2512479060410a6793845e14b3c13206fda662ff67b3fc7ce0cd4100392a',
'last_state': {'running': None,
'terminated': None,
'waiting': None},
'name': 'base',
'ready': False,
'restart_count': 0,
'state': {'running': None,
'terminated': {'container_id': 'cri-o://8d0765e9f10aa65f244386db6792e7667b2b287c2b513bb85990c3fc27390520',
'exit_code': 1,
'finished_at': datetime.datetime(2023, 1, 10, 14, 52, 42, tzinfo=tzlocal()),
'message': None,
'reason': 'Error',
'signal': None,
'started_at': datetime.datetime(2023, 1, 10, 14, 52, 40, tzinfo=tzlocal())},
'waiting': None}}],
'host_ip': '10.221.213.108',
'init_container_statuses': None,
'message': None,
'nominated_node_name': None,
'phase': 'Failed',
'pod_ip': '172.30.227.142',
'qos_class': 'BestEffort',
'reason': None,
'start_time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal())}}
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1157, in _run_raw_task
self._prepare_and_execute_task_with_callbacks(context, task)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1331, in _prepare_and_execute_task_with_callbacks
result = self._execute_task(context, task_copy)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1356, in _execute_task
result = task_copy.execute(context=context)
File "/home/airflow/.local/lib/python3.8/site-packages/airflow/providers/cncf/kubernetes/operators/kubernetes_pod.py", line 373, in execute
raise AirflowException(f'Pod Launching failed: {ex}')
airflow.exceptions.AirflowException: Pod Launching failed: Pod segy-to-zgy.ea9abe38880c42f4b4544b3488863711 returned a failure: {'api_version': 'v1',
'kind': 'Pod',
'metadata': {'annotations': {'cni.projectcalico.org/containerID': '08dfa478236098077857ae0f258ec47285641ee5fb0bb8ff7794e90490f28d40',
'cni.projectcalico.org/podIP': '',
'cni.projectcalico.org/podIPs': '',
'k8s.v1.cni.cncf.io/network-status': '[{\n'
' '
'"name": '
'"k8s-pod-network",\n'
' "ips": '
'[\n'
' '
'"172.30.227.142"\n'
' ],\n'
' '
'"default": '
'true,\n'
' "dns": '
'{}\n'
'}]',
'k8s.v1.cni.cncf.io/networks-status': '[{\n'
' '
'"name": '
'"k8s-pod-network",\n'
' '
'"ips": [\n'
' '
'"172.30.227.142"\n'
' ],\n'
' '
'"default": '
'true,\n'
' '
'"dns": '
'{}\n'
'}]',
'openshift.io/scc': 'anyuid'},
'cluster_name': None,
'creation_timestamp': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal()),
'deletion_grace_period_seconds': None,
'deletion_timestamp': None,
'finalizers': None,
'generate_name': None,
'generation': None,
'initializers': None,
'labels': {'***_version': '2.1.1',
'dag_id': 'sgy-to-zgy',
'execution_date': '2023-01-10T145233.7889390000-87f81d4fa',
'kubernetes_pod_operator': 'True',
'task_id': 'segy-to-zgy',
'try_number': '1'},
'managed_fields': [{'api_version': 'v1',
'fields': None,
'manager': 'OpenAPI-Generator',
'operation': 'Update',
'time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal())},
{'api_version': 'v1',
'fields': None,
'manager': 'multus',
'operation': 'Update',
'time': datetime.datetime(2023, 1, 10, 14, 52, 39, tzinfo=tzlocal())},
{'api_version': 'v1',
'fields': None,
'manager': 'Go-http-client',
'operation': 'Update',
'time': datetime.datetime(2023, 1, 10, 14, 52, 43, tzinfo=tzlocal())}],
'name': 'segy-to-zgy.ea9abe38880c42f4b4544b3488863711',
'namespace': 'osdu',
'owner_references': None,
'resource_version': '121815072',
'self_link': None,
'uid': '874be3d5-7bfc-4e44-af80-43c761c9b35e'},
'spec': {'active_deadline_seconds': None,
'affinity': {'node_affinity': None,
'pod_affinity': None,
'pod_anti_affinity': None},
'automount_service_account_token': None,
'containers': [{'args': ['--osdu',
'opendes:dataset--FileCollection.SEGY:660362:',
'opendes:work-product--WorkProduct:660362:'],
'command': None,
'env': [{'name': 'STORAGE_SVC_URL',
'value': 'http://os-storage-ibm:8080/api/storage/v2/',
'value_from': None},
{'name': 'SD_SVC_URL',
'value': 'http://os-seismic-store-service:8080/api/v3',
'value_from': None},
{'name': 'SD_SVC_TOKEN',
'value': 'Bearer '
'eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJsTFluRU1KUlBfOVBWeVdTdmZkdlNva2VmUlEtQ0k2dE5TbGpOZjh4VDlvIn0.eyJleHAiOjE2NzMzODI4OTcsImlhdCI6MTY3MzM2MTI5NywianRpIjoiZDMyNTE0YmEtZmUxNy00OTdjLWEzODUtNGE4NGM1MzVmYjVhIiwiaXNzIjoiaHR0cHM6Ly9rZXljbG9hay1vc2R1Lm9kaS1vZy1vc2R1LWJhOGUzOGQ0YzAxMWQ2MjczNzlhZjFhNDI4MGM0ZTM1LTAwMDAudXMtc291dGguY29udGFpbmVycy5hcHBkb21haW4uY2xvdWQvYXV0aC9yZWFsbXMvT1NEVSIsInN1YiI6IjZlMmIxMDFjLWIyMjMtNDYwNi05YzMxLWVhZDg0YzBhMDVlMCIsInR5cCI6IkJlYXJlciIsImF6cCI6Im9zZHUtbG9naW4iLCJzZXNzaW9uX3N0YXRlIjoiYzdmZTlhNTktZGYxMC00ZWQ2LTkxYTMtNTlhZWM2YjhiOWJiIiwiYWNyIjoiMSIsInJlYWxtX2FjY2VzcyI6eyJyb2xlcyI6WyJkZWZhdWx0LXJvbGVzLW9zZHUiXX0sInNjb3BlIjoib3BlbmlkIHByb2ZpbGUgZW1haWwiLCJzaWQiOiJjN2ZlOWE1OS1kZjEwLTRlZDYtOTFhMy01OWFlYzZiOGI5YmIiLCJlbWFpbF92ZXJpZmllZCI6ZmFsc2UsIm5hbWUiOiJwcmVzaGlwdGVhbWEgb3Blbmdyb3VwIiwicHJlZmVycmVkX3VzZXJuYW1lIjoicHJlc2hpcHRlYW1hIiwiZ2l2ZW5fbmFtZSI6InByZXNoaXB0ZWFtYSIsImZhbWlseV9uYW1lIjoib3Blbmdyb3VwIiwiZW1haWwiOiJwcmVzaGlwdGVhbWFAb3NkdS5vcGVuZ3JvdXAub3JnIn0.UcmWMYp-M9eDsvg4zaFgfMFyaDbd-bKJ9g7i6PRovHULi06UVomooYj_wPuoysbI3880X51iaU6gsBSc8iTUzFhsopOmw8Nm_PgJtJ79p3XDauTVd1mOBKsRLqlqLciTK26KLelu9bs7R2VlNqP-qXAFtWu-p4ExlS3LvkVXI0l3t7IGV4LD4-8VDBK3_5iMAIPswf5moB137GVJhDtsnIWL5TGV-j0a9CwriS35ZK_DRz_4BIOe5C_zua6mDCh1jqwtKUnkcK1YLYaDE3T-SwiFDZqFW5Ev7ZK8MFqTVCwrp1a9PLqXhBFBqWIzFdX0rVskdusXWq0lnyCC9kvG1w',
'value_from': None},
{'name': 'SPATIALREF_SVC_TOKEN',
'value': 'authorization',
'value_from': None},
{'name': 'STORAGE_SVC_TOKEN',
'value': 'Bearer '
'eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJsTFluRU1KUlBfOVBWeVdTdmZkdlNva2VmUlEtQ0k2dE5TbGpOZjh4VDlvIn0.eyJleHAiOjE2NzMzODI4OTcsImlhdCI6MTY3MzM2MTI5NywianRpIjoiZDMyNTE0YmEtZmUxNy00OTdjLWEzODUtNGE4NGM1MzVmYjVhIiwiaXNzIjoiaHR0cHM6Ly9rZXljbG9hay1vc2R1Lm9kaS1vZy1vc2R1LWJhOGUzOGQ0YzAxMWQ2MjczNzlhZjFhNDI4MGM0ZTM1LTAwMDAudXMtc291dGguY29udGFpbmVycy5hcHBkb21haW4uY2xvdWQvYXV0aC9yZWFsbXMvT1NEVSIsInN1YiI6IjZlMmIxMDFjLWIyMjMtNDYwNi05YzMxLWVhZDg0YzBhMDVlMCIsInR5cCI6IkJlYXJlciIsImF6cCI6Im9zZHUtbG9naW4iLCJzZXNzaW9uX3N0YXRlIjoiYzdmZTlhNTktZGYxMC00ZWQ2LTkxYTMtNTlhZWM2YjhiOWJiIiwiYWNyIjoiMSIsInJlYWxtX2FjY2VzcyI6eyJyb2xlcyI6WyJkZWZhdWx0LXJvbGVzLW9zZHUiXX0sInNjb3BlIjoib3BlbmlkIHByb2ZpbGUgZW1haWwiLCJzaWQiOiJjN2ZlOWE1OS1kZjEwLTRlZDYtOTFhMy01OWFlYzZiOGI5YmIiLCJlbWFpbF92ZXJpZmllZCI6ZmFsc2UsIm5hbWUiOiJwcmVzaGlwdGVhbWEgb3Blbmdyb3VwIiwicHJlZmVycmVkX3VzZXJuYW1lIjoicHJlc2hpcHRlYW1hIiwiZ2l2ZW5fbmFtZSI6InByZXNoaXB0ZWFtYSIsImZhbWlseV9uYW1lIjoib3Blbmdyb3VwIiwiZW1haWwiOiJwcmVzaGlwdGVhbWFAb3NkdS5vcGVuZ3JvdXAub3JnIn0.UcmWMYp-M9eDsvg4zaFgfMFyaDbd-bKJ9g7i6PRovHULi06UVomooYj_wPuoysbI3880X51iaU6gsBSc8iTUzFhsopOmw8Nm_PgJtJ79p3XDauTVd1mOBKsRLqlqLciTK26KLelu9bs7R2VlNqP-qXAFtWu-p4ExlS3LvkVXI0l3t7IGV4LD4-8VDBK3_5iMAIPswf5moB137GVJhDtsnIWL5TGV-j0a9CwriS35ZK_DRz_4BIOe5C_zua6mDCh1jqwtKUnkcK1YLYaDE3T-SwiFDZqFW5Ev7ZK8MFqTVCwrp1a9PLqXhBFBqWIzFdX0rVskdusXWq0lnyCC9kvG1w',
'value_from': None},
{'name': 'STORAGE_SVC_API_KEY',
'value': None,
'value_from': None},
{'name': 'SD_SVC_API_KEY',
'value': 'ok',
'value_from': None},
{'name': 'OSDU_DATAPARTITIONID',
'value': 'opendes',
'value_from': None},
{'name': 'SD_READ_CACHE_PAGE_SIZE',
'value': '4195024',
'value_from': None},
{'name': 'SD_READ_CACHE_MAX_PAGES',
'value': '256',
'value_from': None},
{'name': 'SEGYTOZGY_VERBOSITY',
'value': '3',
'value_from': None},
{'name': 'SEGYTOZGY_GENERATE_INDEX',
'value': '1',
'value_from': None},
{'name': 'IBM_COS_URL',
'value': 'minio-osdu.odi-og-osdu-ba8e38d4c011d627379af1a4280c4e35-0000.us-south.containers.appdomain.cloud',
'value_from': None}],
'env_from': None,
'image': 'community.opengroup.org:5555/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/segy-to-zgy-conversion-v0-18-1:4853f21ab06b5b65b1bafc82b0869583e279cbaf',
'image_pull_policy': 'IfNotPresent',
'lifecycle': None,
'liveness_probe': None,
'name': 'base',
'ports': None,
'readiness_probe': None,
'resources': {'limits': None, 'requests': None},
'security_context': {'allow_privilege_escalation': None,
'capabilities': {'add': None,
'drop': ['MKNOD']},
'privileged': None,
'proc_mount': None,
'read_only_root_filesystem': None,
'run_as_group': None,
'run_as_non_root': None,
'run_as_user': None,
'se_linux_options': None,
'windows_options': None},
'stdin': None,
'stdin_once': None,
'termination_message_path': '/dev/termination-log',
'termination_message_policy': 'File',
'tty': None,
'volume_devices': None,
'volume_mounts': [{'mount_path': '/var/run/secrets/kubernetes.io/serviceaccount',
'mount_propagation': None,
'name': 'kube-api-access-vjxws',
'read_only': True,
'sub_path': None,
'sub_path_expr': None}],
'working_dir': None}],
'dns_config': None,
'dns_policy': 'ClusterFirst',
'enable_service_links': True,
'host_aliases': None,
'host_ipc': None,
'host_network': None,
'host_pid': None,
'hostname': None,
'image_pull_secrets': [{'name': 'docker-pull-hyc-idp-docker-local-artifactory-swg-devops-com-base-registry'},
{'name': 'docker-pull-hyc-idp-docker-local-artifactory-swg-devops-com-anotherbase-registry'},
{'name': 'docker-pull-hyc-idp-docker-local-artifactory-swg-devops-com-base-registry-registry'},
{'name': 'default-dockercfg-86tkd'}],
'init_containers': None,
'node_name': '10.221.213.108',
'node_selector': None,
'preemption_policy': 'PreemptLowerPriority',
'priority': 0,
'priority_class_name': None,
'readiness_gates': None,
'restart_policy': 'Never',
'runtime_class_name': None,
'scheduler_name': 'default-scheduler',
'security_context': {'fs_group': None,
'run_as_group': None,
'run_as_non_root': None,
'run_as_user': None,
'se_linux_options': {'level': 's0:c25,c20',
'role': None,
'type': None,
'user': None},
'supplemental_groups': None,
'sysctls': None,
'windows_options': None},
'service_account': 'default',
'service_account_name': 'default',
'share_process_namespace': None,
'subdomain': None,
'termination_grace_period_seconds': 30,
'tolerations': [{'effect': 'NoExecute',
'key': 'node.kubernetes.io/not-ready',
'operator': 'Exists',
'toleration_seconds': 300,
'value': None},
{'effect': 'NoExecute',
'key': 'node.kubernetes.io/unreachable',
'operator': 'Exists',
'toleration_seconds': 300,
'value': None}],
'volumes': [{'aws_elastic_block_store': None,
'azure_disk': None,
'azure_file': None,
'cephfs': None,
'cinder': None,
'config_map': None,
'csi': None,
'downward_api': None,
'empty_dir': None,
'fc': None,
'flex_volume': None,
'flocker': None,
'gce_persistent_disk': None,
'git_repo': None,
'glusterfs': None,
'host_path': None,
'iscsi': None,
'name': 'kube-api-access-vjxws',
'nfs': None,
'persistent_volume_claim': None,
'photon_persistent_disk': None,
'portworx_volume': None,
'projected': {'default_mode': 420,
'sources': [{'config_map': None,
'downward_api': None,
'secret': None,
'service_account_token': {'audience': None,
'expiration_seconds': 3607,
'path': 'token'}},
{'config_map': {'items': [{'key': 'ca.crt',
'mode': None,
'path': 'ca.crt'}],
'name': 'kube-root-ca.crt',
'optional': None},
'downward_api': None,
'secret': None,
'service_account_token': None},
{'config_map': None,
'downward_api': {'items': [{'field_ref': {'api_version': 'v1',
'field_path': 'metadata.namespace'},
'mode': None,
'path': 'namespace',
'resource_field_ref': None}]},
'secret': None,
'service_account_token': None},
{'config_map': {'items': [{'key': 'service-ca.crt',
'mode': None,
'path': 'service-ca.crt'}],
'name': 'openshift-service-ca.crt',
'optional': None},
'downward_api': None,
'secret': None,
'service_account_token': None}]},
'quobyte': None,
'rbd': None,
'scale_io': None,
'secret': None,
'storageos': None,
'vsphere_volume': None}]},
'status': {'conditions': [{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal()),
'message': None,
'reason': None,
'status': 'True',
'type': 'Initialized'},
{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 43, tzinfo=tzlocal()),
'message': 'containers with unready status: [base]',
'reason': 'ContainersNotReady',
'status': 'False',
'type': 'Ready'},
{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 43, tzinfo=tzlocal()),
'message': 'containers with unready status: [base]',
'reason': 'ContainersNotReady',
'status': 'False',
'type': 'ContainersReady'},
{'last_probe_time': None,
'last_transition_time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal()),
'message': None,
'reason': None,
'status': 'True',
'type': 'PodScheduled'}],
'container_statuses': [{'container_id': 'cri-o://8d0765e9f10aa65f244386db6792e7667b2b287c2b513bb85990c3fc27390520',
'image': 'community.opengroup.org:5555/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/segy-to-zgy-conversion-v0-18-1:4853f21ab06b5b65b1bafc82b0869583e279cbaf',
'image_id': 'community.opengroup.org:5555/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/segy-to-zgy-conversion-v0-18-1@sha256:1a0e2512479060410a6793845e14b3c13206fda662ff67b3fc7ce0cd4100392a',
'last_state': {'running': None,
'terminated': None,
'waiting': None},
'name': 'base',
'ready': False,
'restart_count': 0,
'state': {'running': None,
'terminated': {'container_id': 'cri-o://8d0765e9f10aa65f244386db6792e7667b2b287c2b513bb85990c3fc27390520',
'exit_code': 1,
'finished_at': datetime.datetime(2023, 1, 10, 14, 52, 42, tzinfo=tzlocal()),
'message': None,
'reason': 'Error',
'signal': None,
'started_at': datetime.datetime(2023, 1, 10, 14, 52, 40, tzinfo=tzlocal())},
'waiting': None}}],
'host_ip': '10.221.213.108',
'init_container_statuses': None,
'message': None,
'nominated_node_name': None,
'phase': 'Failed',
'pod_ip': '172.30.227.142',
'qos_class': 'BestEffort',
'reason': None,
'start_time': datetime.datetime(2023, 1, 10, 14, 52, 38, tzinfo=tzlocal())}}
[2023-01-10 14:52:46,974] {taskinstance.py:1544} INFO - Marking task as FAILED. dag_id=sgy-to-zgy, task_id=segy-to-zgy, execution_date=20230110T145233, start_date=20230110T145237, end_date=20230110T145246
[2023-01-10 14:52:47,033] {local_task_job.py:151} INFO - Task exited with return code 1