New Reference data types are not getting ingested using WITSML parser in Preshipping M19 Azure & GCP environment.
Currently I am using M19 preshipping Azure & GCP environment to test the below case.
I am trying to ingest a well WITSML file (attached to this issue) which has few reference data types along master data. Below I have copied few reference attributes from the XML file which I am trying to ingest.
DKelly BushingDkelly bushing
78.5
unknown
DSea Level
Dmean sea level
unknown
When I am trying to ingested this XML file, ideally it should ingest reference data first as per hierarchy and then rest of the master data but here in this example, it searches for reference data and shows error that missing in the instance.
If I use Kelly Bushing instead of DKelly Bushing then ingestion will work and able to see the results in search/storage query. But I use a name which has not ingested so far in the given instance like example : DKelly Bushing, Rotary Table then it will throw error.
Errors which I am seeing in Airflow:
{'id': 'm19:master-data--Well:Durga70636287-98CA-4684-AD49-F65BC1D925FD', 'kind': 'osdu:wks:master-data--Well:1.0.0', 'reason': 'Missing parents: {SRN: m19:reference-data--VerticalMeasurementType:Dkelly%20bushing, SRN: m19:reference-data--VerticalMeasurementType:Dmean%20sea%20level}
Open questions:
- Do I need to ingest the reference data types from the XML file first before ingesting any of the data?
- Does anyone faced similar problems when they to ingest a reference data which is not ingested till now?