Search merge requestshttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests2023-08-18T22:06:35Zhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/132change some info logs to debug2023-08-18T22:06:35ZAlok Joshichange some info logs to debug1. Upgrade core-lib-azure library to make use of info to debug log changes in the latest RC version
2. Incorporate debug logs into Search service. This is an effort to reduce the cost associated with storing trace (info) logs.1. Upgrade core-lib-azure library to make use of info to debug log changes in the latest RC version
2. Incorporate debug logs into Search service. This is an effort to reduce the cost associated with storing trace (info) logs.M7 - Release 0.10Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/131(GONRG-2419) Enabling publish step2023-08-18T22:06:36ZVladislav Shishko (EPAM)(GONRG-2419) Enabling publish stepM7 - Release 0.10Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/128Fix double path replacement for nested query2023-08-18T22:06:40ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comFix double path replacement for nested query# Description:
Fix for nested queries & test refactoring
# Changes include:
- [x] Bugfix (a non-breaking change that solves an issue).
# Changes in:
- [x] Common code
# Dev Checklist:
- [x] Added Unit Tests, wherever applicable.
- [x...# Description:
Fix for nested queries & test refactoring
# Changes include:
- [x] Bugfix (a non-breaking change that solves an issue).
# Changes in:
- [x] Common code
# Dev Checklist:
- [x] Added Unit Tests, wherever applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.M7 - Release 0.10Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/127(GONRG-2409) gcp helm charts2023-08-18T22:06:41ZVladislav Shishko (EPAM)(GONRG-2409) gcp helm chartsM7 - Release 0.10Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/126update tutorial and swagger documentation to reflect correct max record count...2023-08-18T22:06:43ZNeelesh Thakurupdate tutorial and swagger documentation to reflect correct max record count per requestUpdate tutorial and swagger documentation to reflect correct max record count per request. It's changed to 100 --> 1000 per request some time back.Update tutorial and swagger documentation to reflect correct max record count per request. It's changed to 100 --> 1000 per request some time back.M7 - Release 0.10https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/125Gcp timeout exception search (GONRG-2509)2023-08-18T22:06:45ZRiabokon Stanislav(EPAM)[GCP]Gcp timeout exception search (GONRG-2509)## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IB...## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
It returns 500.
## What is the new/expected behavior?
Added java.net.SocketTimeoutException during search. It will return 408 instead of 500.
## Any other useful informationM7 - Release 0.10Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/122enable sort on text fields inside the data block2023-08-18T22:06:46ZNeelesh Thakurenable sort on text fields inside the data block- enables sort on text fields (inside the data block)
- provide feedback to user if unsupported field is provided on SortQuery. Users will get error message:
```
{
"code": 400,
"reason": "Bad Request",
"message": "Sort is no...- enables sort on text fields (inside the data block)
- provide feedback to user if unsupported field is provided on SortQuery. Users will get error message:
```
{
"code": 400,
"reason": "Bad Request",
"message": "Sort is not supported for one or more of the requested fields"
}
```
- resolves issue [44](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/44)
- refactor & clean field type mapping implementation and move it to core package to avoid copying same code for all providersM7 - Release 0.10https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/121Nested query search2023-08-18T22:06:48ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comNested query search## Type of change
- [x] Feature
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/38
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implement...## Type of change
- [x] Feature
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/38
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] IBM
- [x] Common code
## Does this introduce a breaking change?
- [NO]
## How to test:
Functionality can be tested with several requests:<br/>
With pure nested queries and their combination:
~~~
{
"kind": "osdu:wks:work-product-component--WellboreMarkerSet:1.0.0",
"query":"nested(data.Markers, (MarkerMeasuredDepth:(<15) AND MarkerName:\"North Sea Supergroup\"))"
}
~~~
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query":"nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\")) AND nested(data.FacilityOperators, (FacilityOperatorID:\"Example*\"))",
"limit":100
}
~~~
And with combination of string queries and nested queries:
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query":"data.Source:\"Example*\" AND nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\"))",
"limit":100
}
~~~
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query":"data.Source:\"Example*\" AND nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\")) AND data.FacilityName:\"Example*\"",
"limit":100
}
~~~
Sort and aggregation also can be tested:
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query": "data.Source:\"Example*\" AND nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\"))",
"limit": 100,
"sort": {
"field": [
"nested(data.FacilityOperators, TerminationDateTime, min)"
],
"order": [
"ASC"
]
},
"aggregateBy": "nested(data.VerticalMeasurements, VerticalMeasurement)"
}
~~~
## Dev Checklist:
- [x] Added Unit Tests, wherever applicable.
- [x] Updated the Readme, if applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.M7 - Release 0.10Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/119Avoiding Tenant Validation On Wildcard Search For Kind. Fix #432023-08-18T22:06:51ZManish SinghAvoiding Tenant Validation On Wildcard Search For Kind. Fix #43Please validate the changes against the issue number #43 and if everything looks ok please merge the same to the master branch.
/cc @shrikgar FYI,Please validate the changes against the issue number #43 and if everything looks ok please merge the same to the master branch.
/cc @shrikgar FYI,M7 - Release 0.10Shrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/116provide consistent response when non-existent kind is queried2023-08-18T22:06:56ZNeelesh Thakurprovide consistent response when non-existent kind is queriedaddresses issue: [42](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/42)addresses issue: [42](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/42)M7 - Release 0.10https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/114customize elastic latency logging, ignore health logging, increase version of...2023-08-18T22:06:59ZYauheni Lesnikaucustomize elastic latency logging, ignore health logging, increase version of spring boot;This changes intended to decrease amount of logs from search service.
Here I've updated 2 things:
1) introduce elasticsearch latency log configuration
2) add ignore path for health check logs
3) change ElasticClientHandler redundant i...This changes intended to decrease amount of logs from search service.
Here I've updated 2 things:
1) introduce elasticsearch latency log configuration
2) add ignore path for health check logs
3) change ElasticClientHandler redundant info logs to debugM7 - Release 0.10Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/105redis fall back logic2023-08-18T22:07:10ZMingyang Zhuredis fall back logicrelated issues: https://community.opengroup.org/osdu/platform/system/search-service/-/issues/40related issues: https://community.opengroup.org/osdu/platform/system/search-service/-/issues/40M7 - Release 0.10Mingyang ZhuMingyang Zhuhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/155EKS Deploy2023-08-18T22:06:09ZMatt WiseEKS Deploycommit edbc4b49
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Thu May 27 2021 10:16:11 GMT-0500 (Central Daylight Time)
"Excluding springs default security, locking down mvn central"commit edbc4b49
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Thu May 27 2021 10:16:11 GMT-0500 (Central Daylight Time)
"Excluding springs default security, locking down mvn central"M8 - Release 0.11Matt WiseMatt Wisehttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/154(GONRG-3026) switch deploy to gke2023-08-18T22:06:11ZVladislav Shishko (EPAM)(GONRG-3026) switch deploy to gkeM8 - Release 0.11Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/153fix azure IT pipeline for missing com.azure:azure-storage-blob:jar:12.3.0 dep...2023-08-18T22:06:12ZNeelesh Thakurfix azure IT pipeline for missing com.azure:azure-storage-blob:jar:12.3.0 dependencyM8 - Release 0.11https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/151remove reference of old maven slb-des-ext-collaboration and obsolete test files2023-08-18T22:06:14ZNeelesh Thakurremove reference of old maven slb-des-ext-collaboration and obsolete test files- Remove references of old maven ADO package manager from `slb-des-ext-collaboration`. These configurations are not longer in use.
- Remove obsolete IT test files. These were Indexer service resources and moved to Indexer service project...- Remove references of old maven ADO package manager from `slb-des-ext-collaboration`. These configurations are not longer in use.
- Remove obsolete IT test files. These were Indexer service resources and moved to Indexer service project now.M8 - Release 0.11https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/150Update resources limits [GONRG-2974]2023-08-18T22:06:15ZMikhail Piatliou (EPAM)Update resources limits [GONRG-2974]M8 - Release 0.11Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/149sort by relevancy score2023-08-18T22:06:17ZNeelesh Thakursort by relevancy scoreBy default Search service returns result in relevancy order (descending).
This MR enables reverse sort by relevancy score. This is particularly very useful feature if query response returns lot of records and users want to look at the ...By default Search service returns result in relevancy order (descending).
This MR enables reverse sort by relevancy score. This is particularly very useful feature if query response returns lot of records and users want to look at the last few pages.M8 - Release 0.11https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/148handle expired cursor2023-08-18T22:06:19ZNeelesh Thakurhandle expired cursorIntercept and handle expired cursor request. It should not throw 500 errors.
Addresses issue #60Intercept and handle expired cursor request. It should not throw 500 errors.
Addresses issue #60M8 - Release 0.11https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/147Added rollme annotation2023-08-18T22:06:21ZOleksii Tsyganov (EPAM)Added rollme annotationM8 - Release 0.11Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)