M17 GCP Date Range Search Does not return expected Results
Using the postoman collection: https://community.opengroup.org/osdu/platform/pre-shipping/-/blob/main/R3-M17/QA_Artifacts_M17/envFilesAndCollections/Search%20API%20R3%20CI-CD%20v1.0.postman_collection.json
When performing search D18. Get Wells with FacilityEvents Effective Date between X and Y No Results are returned
curl --location 'https://preship.gcp.gnrg-osdu.projects.epam.com/api/search/v2/query' \
--header 'Content-Type: application/json' \
--header 'data-partition-id: odesprod' \
--header 'Authorization: Bearer ...' \
--data '{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query": "data.FacilityEvents.EffectiveDateTime: [1910-01-19 TO 2008-12-31]",
"sort": {
"field": ["data.FacilityEvents.EffectiveDateTime"],
"order": ["DESC"]
},
"limit": 30
}
'
Response:
{
"results": [],
"aggregations": [],
"totalCount": 0
}
When I remove the query field, I do get results where some of wells have an EffectiveDateTime between the 1910-09-19 and 2008-12-31.
curl --location 'https://preship.gcp.gnrg-osdu.projects.epam.com/api/search/v2/query' \
--header 'Content-Type: application/json' \
--header 'data-partition-id: odesprod' \
--header 'Authorization: Bearer ...' \
--data '{
"kind": "osdu:wks:master-data--Well:1.0.0",
"sort": {
"field": ["data.FacilityEvents.EffectiveDateTime"],
"order": ["DESC"]
},
"limit": 1
}
'
Response:
{
"results": [
{
"id": "odesprod:master-data--Well:1112-12631"
},
...
{
"data": {
"FacilityEvents": [
{
"EffectiveDateTime": "1975-04-07T00:00:00+0000"
},
{
"EffectiveDateTime": "1975-05-10T00:00:00+0000"
}
]
},
"id": "odesprod:master-data--Well:1110"
},
{
"data": {
"FacilityEvents": [
{
"EffectiveDateTime": "1975-05-02T00:00:00+0000"
},
{
"EffectiveDateTime": "1975-06-14T00:00:00+0000"
}
]
},
"id": "odesprod:master-data--Well:1111"
},
{
"data": {
"FacilityEvents": [
{
"EffectiveDateTime": "1975-06-15T00:00:00+0000"
},
{
"EffectiveDateTime": "1975-07-10T00:00:00+0000"
}
]
},
"id": "odesprod:master-data--Well:1112"
},
{
"data": {
"FacilityEvents": [
{
"EffectiveDateTime": "1975-03-05T00:00:00+0000"
},
{
"EffectiveDateTime": "1975-04-06T00:00:00+0000"
}
]
},
"id": "odesprod:master-data--Well:1109"
},
...
],
"aggregations": null,
"totalCount": 5197
}
Could this be the result of an older master-data--Well schema being used where data.FacilityEvents was not indexed as a nested field or an issue with the well records being ingested when an older master-data--Well schema was in place where data.FacilityEvents was not indexed as a nested field.