IBM master data injection shows success without passing validation
Ingest the following master data:3.load_Well.json
In task provide_manifest_integrity_task, I see the following warning:
[2021-09-23 20:40:11,579] {logging_mixin.py:112} INFO - Running %s on host %s <TaskInstance: Osdu_ingest.provide_manifest_integrity_task 2021-09-23T20:38:08+00:00 [running]> airflow-worker-0.airflow-worker.odi-airflow-ns.svc.cluster.local
[2021-09-23 20:40:50,247] {logging_mixin.py:112} INFO - [2021-09-23 20:40:50,246] {validate_referential_integrity.py:210} WARNING - Resource with kind opendes:wks:master-data--Well:1.0.0 and id: 'opendes:master-data--Well:fcd27e71-28a5-4cb9-b8ad-4bad397b3613' was rejected. Missing ids '{'opendes:master-data--GeoPoliticalEntity:Limburg:', 'opendes:master-data--GeoPoliticalEntity:Netherlands:', 'opendes:master-data--GeoPoliticalEntity:L:'}'
[2021-09-23 20:40:50,367] {taskinstance.py:1065} INFO - Marking task as SUCCESS.dag_id=Osdu_ingest, task_id=provide_manifest_integrity_task, execution_date=20210923T203808, start_date=20210923T204011, end_date=20210923T204050
[2021-09-23 20:40:51,537] {logging_mixin.py:112} INFO - [2021-09-23 20:40:51,536] {local_task_job.py:103} INFO - Task exited with return code 0
The master data is not being ingested because some reference ids are missing. But the entire workflow ("runId": "331b1678-5168-40ee-bfd1-8dccef2eabd1") finished successfully.