In Microsoft Azure environment segy_to_zgy conversion is not working. The job does not finish for long time and then detail log in not available
In pre-ship R3M9 environment (osdu-ship.msft-osdu-test.org) When trying to perform segy_to_zgy conversion using DAG segy-to-zgy-conversion-0.10.0, The DAG does not complete the processing. Looking at the log it appears that it fails after running for 24 hours. There are 3 DAGs to perform this conversion, I have tried all three with no success. First question is which DAG should I be using? When Looking at the log do not get much information. It says log does not exist. ** Log file does not exist: /opt/airflow/logs/b11d0aaf-7db7-4029-96b9-ef00280d78d9/segy-to-zgy-conversion-0.10.0/segy-to-zgy/2022-01-21T19:20:09.209985+00:00/7aba2fe4-c522-4870-a544-fccc84f2761b/1.log *** Fetching from: http://airflow-worker-0.airflow-worker.airflow.svc.cluster.local:8793/log/b11d0aaf-7db7-4029-96b9-ef00280d78d9/segy-to-zgy-conversion-0.10.0/segy-to-zgy/2022-01-21T19:20:09.209985+00:00/7aba2fe4-c522-4870-a544-fccc84f2761b/1.log *** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for url: http://airflow-worker-0.airflow-worker.airflow.svc.cluster.local:8793/log/b11d0aaf-7db7-4029-96b9-ef00280d78d9/segy-to-zgy-conversion-0.10.0/segy-to-zgy/2022-01-21T19:20:09.209985+00:00/7aba2fe4-c522-4870-a544-fccc84f2761b/1.log