AWS R3M11 – CSV Ingestion Error
AWS R3M11 – CSV Ingestion Error
CSV File Metadata Register via File Service:
{{FILE_HOST}}/files/metadata --> https://r3m11.preshiptesting.osdu.aws/api/file/v2/files/metadata
Response: { "error": { "code": 500, "message": "Internal server error", "errors": [ { "domain": "global", "reason": "internalError", "message": "Internal server error" } ] } }
CSV Ingestion DAG Error via Dataset Service:
Run_Id - " test_workflow659293" Schema ID - osdu:wks:reference-data--ContractorType:1.0.0
Metadata Register Record ID - " osdu:dataset--File.Generic:ec4dde0ded74477f8b8eaee75d0c38c7"
Airflow DAG Log : csv_ingestion_all_steps
File "/home/airflow/.local/lib/python3.7/site-packages/jinja2/runtime.py", line 903, in _fail_with_undefined_error raise self._undefined_exception(self._undefined_message) jinja2.exceptions.UndefinedError: 'dict object' has no attribute 'kind' [2022-04-24, 22:57:46 UTC] {taskinstance.py:1277} INFO - Marking task as FAILED. dag_id=csv_ingestion_all_steps, task_id=csv-parser, execution_date=20220424T225740, start_date=20220424T225746, end_date=20220424T225746 [2022-04-24, 22:57:46 UTC] {standard_task_runner.py:92} ERROR - Failed to execute job 6594 for task csv-parser