Issue with data returned from search service - trying to verify unit conversion (Azure)
I am trying to verify that the unit conversion is working appropriately when using CSV ingestion. When I check the data via the storage service, I see data in input units and can verify it's working properly. When I try to retrieve data records via the search service, it does not show the appropriate data so that we can confirm it is in SI units. I've included the results from M9 running the same query as seen in the uploads in the test results folder run by Debasis. This has the data as expected to verify results.
Current results from M10 testing POST https://{{SEARCH_HOST}}/query { "kind": "opendes:wellbore:testEntity_730993:0.0.1", "query": "id: "opendes:testEntity_730993:wellbore-U1AxNjE2MjM0MTQyNTMx"", "limit": 10 }
{ "results": [ { "createTime": "2022-03-02T13:12:52.193Z", "kind": "opendes:wellbore:testEntity_730993:0.0.1", "authority": "opendes", "namespace": "opendes:wellbore", "legal": { "legaltags": [ "opendes-Test-Legal-Tag-7112912" ], "otherRelevantDataCountries": [ "US" ], "status": "compliant" }, "createUser": "60c4b736-2aa4-4889-88a0-d50503d63de7", "source": "wellbore", "acl": { "viewers": [ "data.default.viewers@opendes.contoso.com" ], "owners": [ "data.default.owners@opendes.contoso.com" ] }, "id": "opendes:testEntity_730993:wellbore-U1AxNjE2MjM0MTQyNTMx", "type": "testEntity_730993", "version": 1646226771801651, "tags": { "dataflowId": "test-dataflowid-proxy" } } ], "aggregations": null, "totalCount": 1 }
Results from M9 testing POST https://{{SEARCH_HOST}}/query
Body { "kind": "opendes:debasis:testEntity_123425:1.0.0", "query": "id: "opendes:testEntity_123425:9886b54d038d4a9fb96af65092882750"", "limit": 10 }
Response
{ "results": [ { "data": { "TVD": 6312.7128, "PERMIT_NUMBER": "SMP-09995", "WELLBORE_NAME": null, "CRS": "GCS_North_American_1927", "LONGUITUDE": -89.66605738, "WELLBORE_NUMBER": null, "STATE": "NORTHERN GULF OF MEXICO", "CLASS": "NEW FIELD WILDCAT", "WELLBORE_SHAPE": "DIRECTIONAL", "FORMATION_AT_TD": "MIOCENE LOWER", "STATUS": "DRY & ABANDONED", "COUNTRY": "USA", "MD": 6388.608, "ORIGINAL_OPERATOR": "SCHLUMBERGER", "BASIN": "AT", "EPSG_CODE": "4267.12", "COUNTY": "ATWATER VALLEY", "UNIT_SYSTEM": "English", "UWI": "SP4358449212881", "FIELD": "ATWATER VLLY B 8", "ELEVATION": 25.606248000000004, "OPERATOR": "SCHLUMBERGER", "LEASE": "SMP G09995", "LATITUDE": 27.85011793, "ELEVATION_REF": "KB" }, "kind": "opendes:debasis:testEntity_123425:1.0.0", "source": "debasis", "acl": { "viewers": [ "data.default.viewers@opendes.contoso.com" ], "owners": [ "data.default.viewers@opendes.contoso.com" ] }, "type": "testEntity_123425", "version": 1638830079687502, "tags": { "dataflowId": "test-dataflowid-proxy" }, "createTime": "2021-12-06T22:34:40.614Z", "authority": "opendes", "namespace": "opendes:debasis", "legal": { "legaltags": [ "opendes-Test-Legal-Tag-9679576" ], "otherRelevantDataCountries": [ "US" ], "status": "compliant" }, "createUser": "60c4b736-2aa4-4889-88a0-d50503d63de7", "id": "opendes:testEntity_123425:9886b54d038d4a9fb96af65092882750" } ], "aggregations": null, "totalCount": 1 }