IBM - R3M13 - Manifest Ingestion (Master Data)
Hello,
I'm trying to trigger the Master Data Ingestion for Wells and when I trigger the request everything seems to be good. But, when I check in the airflow the Xcom log is empty. Here is what I'm trying to do in Postman:
- Request
curl --location --request POST 'https://cpd-osdu.odi-og-osdu-ba8e38d4c011d627379af1a4280c4e35-0000.us-south.containers.appdomain.cloud/osdu-workflow/api/workflow/v1/workflow/Osdu_ingest/workflowRun'
- Body
{
"executionContext":{
"Payload":{
"AppKey":"test-app",
"data-partition-id":"{{data-partition-id}}"
},
"manifest":{
"kind":"{{authority}}:wks:Manifest:1.0.0",
"MasterData":[
{
"id":"{{data-partition-id}}:master-data--Well:1115-JFA01SEP",
"kind":"{{authority}}:wks:master-data--Well:1.0.0",
"acl":{
"owners":[
"data.default.owners@{{data-partition-id}}{{domain}}"
],
"viewers":[
"data.default.viewers@{{data-partition-id}}{{domain}}"
]
},
"legal":{
"legaltags":[
"{{LegalTagNameExists}}"
],
"otherRelevantDataCountries":[
"US"
]
},
"data":{
"Source":"NL_TNO",
"SpatialLocation":{
"Wgs84Coordinates":{
"type":"FeatureCollection",
"features":[
{
"type":"Feature",
"geometry":{
"type":"Point",
"coordinates":[
3.51906683,
55.68101428
]
},
"properties":{
}
}
]
}
},
"FacilityID":"10110909",
"FacilityTypeID":"{{data-partition-id}}:reference-data--FacilityType:Well-{{randomId}}:",
"FacilityOperator":[
{
"FacilityOperatorID":"410464"
}
],
"FacilityName":"A05-01",
"FacilityNameAlias":[
{
"AliasName":"A05-01"
}
],
"FacilityEvent":[
{
"EffectiveDateTime":"1999-06-03T00:00:00"
}
],
"VerticalMeasurements":[
{
"VerticalMeasurementID":"Kelly Bushing",
"VerticalMeasurement":36.6
}
],
"NameAliases":[
],
"GeoContexts":[
]
}
}
]
}
}
}
- Response
{
"workflowId": "90dabadd45c54d85a682ae3b3ecb181a",
"runId": "dc59992d-fe1c-4219-bc75-2d922e55d9c2",
"startTimeStamp": 1662084819591,
"status": "submitted",
"submittedBy": "preshipteama@osdu.opengroup.org"
}
In Airflow this is what I have for XCom:
- process_single_manifest_file_task
| record_ids | [] |
|-------------|----|
| skipped_ids | [] |
- update_status_finished_task
| saved_record_ids | {} |
|------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| skipped_ids | {'provide_manifest_integrity_task': [{'id': 'opendes:master-data--Well:1115-JFA01SEP', 'kind': 'osdu:wks:master-data--Well:1.0.0', 'reason': 'Missing parents: {SRN: opendes:reference-data--FacilityType:Well-660362}'}]} |
Attached you will find the logs. Please, someone can help me with this? This is also happening in Manifest Ingestion - Frame of Reference (CRS Conversion).
[process_single_manifest_file_task_LOG.rtf] (/uploads/a4525e08d2c3657ebaf4c5144e4e3a3f/process_single_manifest_file_task_LOG.rtf)