Airflow log reports success when failed
Technical Context
- Deployed version: M8 aka release/0.11
- DAG: Osdu_ingest
- Task: process_single_manifest_file_task
Description When running a manifest ingestion we got some errors, but the specific task completed successfully. This can be confusing when trying to debug.
Attaching the last part of the log which shows both the error and the "Marking task as SUCCESS".
[2021-10-25 12:39:34,130] {connectionpool.py:230} DEBUG - Starting new HTTP connection (1): storage.osdu-azure.svc.cluster.local:80 [2021-10-25 12:39:34,178] {connectionpool.py:442} DEBUG - http://storage.osdu-azure.svc.cluster.local:80 "PUT /api/storage/v2/records HTTP/1.1" 400 None [2021-10-25 12:39:34,179] {process_manifest_r3.py:131} ERROR - Request error. [2021-10-25 12:39:34,179] {process_manifest_r3.py:132} ERROR - Response status: 400. Response content: {"code":400,"reason":"Invalid ACL","message":"Acl not match with tenant or domain"}. [2021-10-25 12:39:34,179] {authorization.py:137} ERROR - {"code":400,"reason":"Invalid ACL","message":"Acl not match with tenant or domain"} [2021-10-25 12:39:34,179] {single_manifest_processor.py:79} WARNING - Can't process entity SRN: opendes:reference-data--MaterialType:WTS [2021-10-25 12:39:34,179] {single_manifest_processor.py:255} INFO - Processed ids [] [2021-10-25 12:39:34,179] {process_manifest_r3.py:173} INFO - Processed ids [] [2021-10-25 12:39:34,735] {init.py:62} DEBUG - Backend: None, Lineage called with inlets: [], outlets: [] [2021-10-25 12:39:35,139] {taskinstance.py:1070} INFO - Marking task as SUCCESS.dag_id=Osdu_ingest, task_id=process_single_manifest_file_task, execution_date=20211025T123739, start_date=20211025T123909, end_date=20211025T123935 [2021-10-25 12:39:35,484] {base_job.py:197} DEBUG - [heartbeat] [2021-10-25 12:39:35,485] {local_task_job.py:102} INFO - Task exited with return code 0
Expected result Task and DAG-run marked as failure