Search merge requestshttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests2023-08-18T22:07:13Zhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/103set log level to info for azure provider;2023-08-18T22:07:13ZYauheni Lesnikauset log level to info for azure provider;update log level for azure implementation from DEBUG to INFOupdate log level for azure implementation from DEBUG to INFOM6 - Release 0.9ethiraj krishnamanaiduNitin-slbNeelesh ThakurSherman YangAlok JoshiViacheslav Tarasov - SLBYauheni LesnikauTika Lestari [SLB]ethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/104Gcp support partition service (GONRG-2164)2023-08-18T22:07:11ZRiabokon Stanislav(EPAM)[GCP]Gcp support partition service (GONRG-2164)## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] I...## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
GCP provider does not support to use partition service under SA
## What is the new/expected behavior?
GCP provider supports to use partition service under SAM6 - Release 0.9Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/105redis fall back logic2023-08-18T22:07:10ZMingyang Zhuredis fall back logicrelated issues: https://community.opengroup.org/osdu/platform/system/search-service/-/issues/40related issues: https://community.opengroup.org/osdu/platform/system/search-service/-/issues/40M7 - Release 0.10Mingyang ZhuMingyang Zhuhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/106multitenant-v22023-08-18T22:07:08ZRucha Deshpandemultitenant-v2commit 692fc4dc
Author: Rucha Deshpande <deshruch@amazon.com>
Date: Wed May 05 2021 17:03:17 GMT-0500 (Central Daylight Time)
update entitlements domain
commit 5122beaa
Author: Rucha Deshpande <deshruch@amazon.com>
Date: Wed ...commit 692fc4dc
Author: Rucha Deshpande <deshruch@amazon.com>
Date: Wed May 05 2021 17:03:17 GMT-0500 (Central Daylight Time)
update entitlements domain
commit 5122beaa
Author: Rucha Deshpande <deshruch@amazon.com>
Date: Wed May 05 2021 11:37:21 GMT-0500 (Central Daylight Time)
use Entitlements V2
commit 3db3f424
Author: Rucha Deshpande <deshruch@amazon.com>
Date: Wed May 05 2021 11:36:15 GMT-0500 (Central Daylight Time)
Merge branch 'dev' of codecommit://os-search into dev
commit 8e191b64
Author: Rucha Deshpande <deshruch@amazon.com>
Date: Thu Apr 08 2021 14:34:37 GMT-0500 (Central Daylight Time)
Merge remote-tracking branch 'origin/master' into devM6 - Release 0.9Rucha DeshpandeRucha Deshpandehttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/107Core lib ibm upgrade2023-08-18T22:07:07ZGokul NagareCore lib ibm upgradeM6 - Release 0.9Anuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/108(GONRG-2388) Update .gitlab-ci.yml2023-08-18T22:07:05ZVladislav Shishko (EPAM)(GONRG-2388) Update .gitlab-ci.ymlM6 - Release 0.9Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/109add back support for geo-distance query2023-08-18T22:07:04ZNeelesh Thakuradd back support for geo-distance queryaddresses the issue: [36](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/36)
add back support for geo-distance query. This query endpoint was broken in earlier version of elastic. [Issue ](https://github.co...addresses the issue: [36](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/36)
add back support for geo-distance query. This query endpoint was broken in earlier version of elastic. [Issue ](https://github.com/elastic/elasticsearch/pull/53466)got fixed in >=v7.7.0.M6 - Release 0.9https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/110Added properties for Policy and Partition2023-08-18T22:07:02ZRiabokon Stanislav(EPAM)[GCP]Added properties for Policy and Partition## Type of change
- [ ] Bug Fix
- [X] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud p...## Type of change
- [ ] Bug Fix
- [X] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Default value of police.enabled = false
## What is the new/expected behavior?
Default value of police.enabled = true
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationM6 - Release 0.9Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/111Gcp properties2023-08-18T22:07:01ZRiabokon Stanislav(EPAM)[GCP]Gcp propertiesM6 - Release 0.9Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/114customize elastic latency logging, ignore health logging, increase version of...2023-08-18T22:06:59ZYauheni Lesnikaucustomize elastic latency logging, ignore health logging, increase version of spring boot;This changes intended to decrease amount of logs from search service.
Here I've updated 2 things:
1) introduce elasticsearch latency log configuration
2) add ignore path for health check logs
3) change ElasticClientHandler redundant i...This changes intended to decrease amount of logs from search service.
Here I've updated 2 things:
1) introduce elasticsearch latency log configuration
2) add ignore path for health check logs
3) change ElasticClientHandler redundant info logs to debugM7 - Release 0.10Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/115Partion service as tenantinfo provider(GONRG-2196)2023-08-18T22:06:57ZRiabokon Stanislav(EPAM)[GCP]Partion service as tenantinfo provider(GONRG-2196)# Description:
Added optional service that replace TenantInfoFactory with implementation that utilize Partition Service<br/>
# How to test:
Functionality was tested with Partition service, Schema service successfully consume TenantInfo...# Description:
Added optional service that replace TenantInfoFactory with implementation that utilize Partition Service<br/>
# How to test:
Functionality was tested with Partition service, Schema service successfully consume TenantInfo from Partition Service
# Changes include:
- [x] Refactor (a non-breaking change that improves code maintainability).
- [ ] Bugfix (a non-breaking change that solves an issue).
- [x] New feature (a non-breaking change that adds functionality).
- [ ] Breaking change (a change that is not backward-compatible and/or changes current functionality).
# Changes in:
- [x] GCP
- [ ] Azure
- [ ] AWS
- [ ] IBM
# Dev Checklist:
- [ ] Added Unit Tests, wherever applicable.
- [x] Updated the Readme, if applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.
# Other comments:
Dependencies:<br/>
https://community.opengroup.org/osdu/platform/system/lib/cloud/gcp/os-core-lib-gcp/-/merge_requests/12 <br/>
https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/73 <br/>M6 - Release 0.9Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/116provide consistent response when non-existent kind is queried2023-08-18T22:06:56ZNeelesh Thakurprovide consistent response when non-existent kind is queriedaddresses issue: [42](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/42)addresses issue: [42](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/42)M7 - Release 0.10https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/117Updating policy service flag to true2023-08-18T22:06:54ZAnkit Sharma [Microsoft]Updating policy service flag to trueM6 - Release 0.9Ankit Sharma [Microsoft]Ankit Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/118Update application.properties-service.policy.enabled=true. Controlled now by ...2023-08-18T22:06:53ZRucha DeshpandeUpdate application.properties-service.policy.enabled=true. Controlled now by partition only.M6 - Release 0.9Rucha DeshpandeRucha Deshpandehttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/119Avoiding Tenant Validation On Wildcard Search For Kind. Fix #432023-08-18T22:06:51ZManish SinghAvoiding Tenant Validation On Wildcard Search For Kind. Fix #43Please validate the changes against the issue number #43 and if everything looks ok please merge the same to the master branch.
/cc @shrikgar FYI,Please validate the changes against the issue number #43 and if everything looks ok please merge the same to the master branch.
/cc @shrikgar FYI,M7 - Release 0.10Shrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/120GCP temp fix for policy integration2023-08-18T22:06:50ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comGCP temp fix for policy integrationM6 - Release 0.9Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/121Nested query search2023-08-18T22:06:48ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comNested query search## Type of change
- [x] Feature
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/38
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implement...## Type of change
- [x] Feature
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/38
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] IBM
- [x] Common code
## Does this introduce a breaking change?
- [NO]
## How to test:
Functionality can be tested with several requests:<br/>
With pure nested queries and their combination:
~~~
{
"kind": "osdu:wks:work-product-component--WellboreMarkerSet:1.0.0",
"query":"nested(data.Markers, (MarkerMeasuredDepth:(<15) AND MarkerName:\"North Sea Supergroup\"))"
}
~~~
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query":"nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\")) AND nested(data.FacilityOperators, (FacilityOperatorID:\"Example*\"))",
"limit":100
}
~~~
And with combination of string queries and nested queries:
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query":"data.Source:\"Example*\" AND nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\"))",
"limit":100
}
~~~
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query":"data.Source:\"Example*\" AND nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\")) AND data.FacilityName:\"Example*\"",
"limit":100
}
~~~
Sort and aggregation also can be tested:
~~~
{
"kind": "osdu:wks:master-data--Well:1.0.0",
"query": "data.Source:\"Example*\" AND nested(data.VerticalMeasurements, (VerticalMeasurement:(>15) AND VerticalReferenceID:\"Example*\"))",
"limit": 100,
"sort": {
"field": [
"nested(data.FacilityOperators, TerminationDateTime, min)"
],
"order": [
"ASC"
]
},
"aggregateBy": "nested(data.VerticalMeasurements, VerticalMeasurement)"
}
~~~
## Dev Checklist:
- [x] Added Unit Tests, wherever applicable.
- [x] Updated the Readme, if applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.M7 - Release 0.10Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/122enable sort on text fields inside the data block2023-08-18T22:06:46ZNeelesh Thakurenable sort on text fields inside the data block- enables sort on text fields (inside the data block)
- provide feedback to user if unsupported field is provided on SortQuery. Users will get error message:
```
{
"code": 400,
"reason": "Bad Request",
"message": "Sort is no...- enables sort on text fields (inside the data block)
- provide feedback to user if unsupported field is provided on SortQuery. Users will get error message:
```
{
"code": 400,
"reason": "Bad Request",
"message": "Sort is not supported for one or more of the requested fields"
}
```
- resolves issue [44](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/44)
- refactor & clean field type mapping implementation and move it to core package to avoid copying same code for all providersM7 - Release 0.10https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/124Merge branch 'nested-query-search' (MR 121) into 'release/0.9'2021-06-07T20:55:48ZRostislav Dublin (EPAM)Merge branch 'nested-query-search' (MR 121) into 'release/0.9'Nested query search
See merge request osdu/platform/system/search-service!121
(cherry picked from commit 6fedad36df37f8cb2244c848418dd065f27d3c63)
4ba1c68e Auto commit when pipeline succeeds
359dde6b Security headers added
28dd4b9d Me...Nested query search
See merge request osdu/platform/system/search-service!121
(cherry picked from commit 6fedad36df37f8cb2244c848418dd065f27d3c63)
4ba1c68e Auto commit when pipeline succeeds
359dde6b Security headers added
28dd4b9d Merge branch 'bugfix/GONRG-1759-add-security-headers' into 'integration-master'
4353208b Auto commit when pipeline succeeds
7a6dbf5f Merge remote-tracking branch 'origin/master' into integration-master
cc2118f9 Auto commit when pipeline succeeds
22bf459f Auto commit when pipeline succeeds
c2db747f Auto commit when pipeline succeeds
6a2ead0f Auto commit when pipeline succeeds
818f4233 Auto commit when pipeline succeeds
fddaf72e Auto commit when pipeline succeeds
b06b464a Auto commit when pipeline succeeds
53378b02 Auto commit when pipeline succeeds
8d3cd12c Auto commit when pipeline succeeds
8e127a51 Auto commit when pipeline succeeds
7c344dcb Auto commit when pipeline succeeds
665275b8 Auto commit when pipeline succeeds
d850f958 Auto commit when pipeline succeeds
5bfcbde6 Merge remote-tracking branch 'origin/master' into integration-master
dd959de4 Auto commit when pipeline succeeds
43c1610e Auto commit when pipeline succeeds
6ce9edb6 Auto commit when pipeline succeeds
64f87322 Auto commit when pipeline succeeds
0470eb92 Added GcpServiceAccountJwtClient for GCP
904c5961 Merge branch 'feature/GONRG-2164_partition_policy_gcp' into 'integration-master'
57286fc6 Auto commit when pipeline succeeds
d85b0952 Auto commit when pipeline succeeds
6889c412 Auto commit when pipeline succeeds
6cc287bf Auto commit when pipeline succeeds
b619d8b7 Merge remote-tracking branch 'origin/master' into integration-master
40b97b75 Fixed properties for GCP
3ed53c36 Auto commit when pipeline succeeds
1c816282 Auto commit when pipeline succeeds
946934b0 Auto commit when pipeline succeeds
c9ff673e Merge remote-tracking branch 'origin/master' into integration-master
4ba900ea Merge remote-tracking branch 'origin/master' into integration-master
e72a9204 GONRG-2369 nested query
9980f2fd GONRG-2369 fix for simple query
b93442fa add unit test, fix simple query
672bdd1d Add QueryParserUtil to all CSPs
fd287015 Merge branch 'feature/GONRG-2369-nested-query-search' into nested-query-search
b80bec35 Nested sort & refactoring
fc9a9550 Nested aggregation & refactoring
ca9502c0 extended logging
ce657950 extended logging
c091baac fix range query parsing
3de91d15 Merge remote-tracking branch 'community/nested-query-search' into nested-query-search
4bec06c2 Revert "extended logging"
926e83d1 Revert "extended logging"
e0027726 fix simple nested range query
8abd791f Merge remote-tracking branch 'community/nested-query-search' into nested-query-search
9318f0eb Nested integration tests cases
285d7168 refactoring , review fix
ff92afbf review fix
fd7b125a test cases for sort & aggregation
c1ab3143 test cases for aggregation & sort
771c02d1 The SearchService.md doc updates for nested queries and sorting
363e3be3 Merge remote-tracking branch 'origin/nested-query-search' into nested-query-search
44673cd2 brackets parenthesis validation
52ccf669 Merge remote-tracking branch 'community/nested-query-search' into nested-query-search
2b00b75d brackets parenthesis validation
d6923dd3 The SearchService.md doc updates for nested aggregation
f5fe4ae2 fix method scope & typo
8471c2f8 Merge remote-tracking branch 'community/nested-query-search' into nested-query-search
7433e2f7 change exception handling for SortParserUtil & add unit tests for exceptions
18f37a77 Merge branch 'master' into nested-query-search
4f9b8f43 Merge branch 'master' into nested-query-search
9fdd8c41 update NOTICE
fbce39f5 Update NOTICE 2David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/125Gcp timeout exception search (GONRG-2509)2023-08-18T22:06:45ZRiabokon Stanislav(EPAM)[GCP]Gcp timeout exception search (GONRG-2509)## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IB...## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
It returns 500.
## What is the new/expected behavior?
Added java.net.SocketTimeoutException during search. It will return 408 instead of 500.
## Any other useful informationM7 - Release 0.10Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]