AWS Manifest Data fails. Airflow response issue
@Wibben Hi Greg: Master data – I get the response in Postman, Airflow shows success, but log is not usual and XCom is empty:
Log by attempts
• 1
Jump To End Toggle Wrap
*** Failed to verify remote log exists s3://osdur3m9-ingest-logbucket-1r9-s3airflowbucketprod-wa096wcklrht/logs/Osdu_ingest/process_single_manifest_file_task/2021-12-09T11:13:01.563351+00:00/1.log.
An error occurred (400) when calling the HeadObject operation: Bad Request
*** Falling back to local log
*** Log file does not exist: /opt/airflow/logs/Osdu_ingest/process_single_manifest_file_task/2021-12-09T11:13:01.563351+00:00/1.log
*** Fetching from: http://airflow-worker-5b45cb7d64-np4j5:8793/log/Osdu_ingest/process_single_manifest_file_task/2021-12-09T11:13:01.563351+00:00/1.log
*** Failed to fetch log file from worker. [Errno -2] Name or service not known
XCom Key Value record_ids []
Related issue Steve has faced. Regards, Esmira cc: @debasisc @sje7253bp @sehuboy