In GCP Platform Validation environment - Not able to search the record (that was created using Storage API) using Search API
While testing WITSML parser DAG in the GCP platform validation environment (devtwo), I see that DAG finishes successfully. Using the storage API not able to find the expected record When one looks at the details of the airflow logs, one finds the following: XCom Key Value return_value {'manifest': {'ReferenceData': [], 'MasterData': [{'acl': {'owners': ['data.default.owners@devtwo.dev2.osdu.club'], 'viewers': ['data.default.viewers@devtwo.dev2.osdu.club']}, 'kind': 'devtwo:wks:master-data--Well:1.0.0', 'legal': {'legaltags': ['devtwo-WITSML-Legal-Tag-Test1387421'], 'otherRelevantDataCountries': ['US'], 'status': 'compliant'}, 'createTime': '2022-05-16T21:15:06.587899+00:00', 'data': {'ResourceSecurityClassification': 'devtwo:reference-data--ResourceSecurityClassification:RESTRICTED:', 'SpatialLocation': {'AsIngestedCoordinates': {'features': [{'type': 'AnyCrsFeature', 'geometry': {'type': 'AnyCrsPoint', 'bbox': [0.0, 0.0, 0.0, 0.0], 'coordinates': [0.0, 0.0]}, 'properties': {}}], 'persistableReferenceCrs': 'devtwo:reference-data--CoordinateReferenceSystem:23031:', 'type': 'AnyCrsFeatureCollection', 'CoordinateReferenceSystemID': 'devtwo:reference-data--CoordinateReferenceSystem:23031:'}, 'Wgs84Coordinates': {'features': [{'type': 'Feature', 'geometry': {'type': 'Point', 'coordinates': [0.0, 0.0]}, 'properties': {}}], 'type': 'FeatureCollection'}}, 'FacilityID': 'Govt-Number', 'FacilityName': 'Company Legal Name', 'VerticalMeasurements': [{'VerticalMeasurementID': 'KB', 'VerticalMeasurement': 78.5, 'VerticalMeasurementDescription': 'Kelly Bushing', 'VerticalMeasurementPathID': 'devtwo:reference-data--VerticalMeasurementPath:Elevation:', 'VerticalMeasurementTypeID': 'devtwo:reference-data--VerticalMeasurementType:KB:', 'VerticalMeasurementUnitOfMeasureID': 'devtwo:reference-data--UnitOfMeasure:ft:', 'VerticalReferenceID': 'SL'}, {'VerticalMeasurementID': 'SL', 'VerticalMeasurementDescription': 'Sea Level', 'VerticalMeasurementPathID': 'devtwo:reference-data--VerticalMeasurementPath:Elevation:', 'VerticalMeasurementTypeID': 'devtwo:reference-data--VerticalMeasurementType:MSL:'}]}, 'id': 'devtwo:master-data--Well:WELLAUTOTEST_KTMay16', 'modifyTime': '2022-05-16T21:15:06.587899+00:00', 'version': 1}], 'Data': {'Datasets': [], 'WorkProductComponents': [], 'WorkProduct': {}}, 'kind': 'devtwo:wks:Manifest:1.0.0'}}
skipped_ids [{'id': 'devtwo:dataset--File.WITSML:WELLAUTOTEST_KTMay16', 'kind': 'devtwo:wks:dataset--File.WITSML:1.0.0', 'reason': 'Missing parents: {SRN: devtwo:reference-data--SchemaFormatType:EnergisticsWITSML}'}]
Using Storage API - I can retrieve the record.
Request:
curl --location --request GET 'https://dev2.gcp.gnrg-osdu.projects.epam.com/api/storage/v2/records/devtwo:reference-data--SchemaFormatType:EnergisticsWITSML'
--header 'Content-Type: application/json'
--header 'data-partition-id: devtwo'
--header 'frame-of-reference: units=SI;crs=wgs84;elevation=msl;azimuth=true north;dates=utc;'
--header 'Accept: application/json'
--header 'Authorization: Bearer ya29.a0ARrdaM-EQ-TzRAYNSXRgk7o8dl5SUtwO...by1PWX3U'
**Response**: 200 OK
{
"data": {
"Endian": "BIG"
},
"id": "devtwo:reference-data--SchemaFormatType:EnergisticsWITSML",
"version": 1652719841337471,
"kind": "devtwo:wks:reference-data--SchemaFormatType:1.0.0",
"acl": {
"viewers": [
"data.default.viewers@devtwo.dev2.osdu.club"
],
"owners": [
"data.default.viewers@devtwo.dev2.osdu.club"
]
},
"legal": {
"legaltags": [
"devtwo-WITSML-Legal-Tag-Test7374005"
],
"otherRelevantDataCountries": [
"US"
],
"status": "compliant"
},
"createUser": "kamlesh_todai@osdu-gcp.go3-nrg.projects.epam.com",
"createTime": "2022-05-16T16:50:43.892Z"
}
Using Search API - I Cannot retrieve the record.
Request:
curl --location --request POST 'https://dev2.gcp.gnrg-osdu.projects.epam.com/api/search/v2/query'
--header 'Content-Type: application/json'
--header 'data-partition-id: devtwo'
--header 'Authorization: Bearer ya29.a0ARrdaM-QCGVm66qleS22ZvF7OT3NuWDDje...jKx3lnOHBIIshQR4'
--data-raw '{
"kind": "devtwo:wks:reference-data--SchemaFormatType:1.0.0",
"query": "id:"devtwo:reference-data--SchemaFormatType:EnergisticsWITSML""
}'
**Response:** 200 OK
{
"results": [],
"aggregations": [],
"totalCount": 0
}