Search merge requestshttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests2023-08-18T22:05:08Zhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/236GONRG-4309: Cost optimization for service2023-08-18T22:05:08ZNastassia Rabeichykava (EPAM)GONRG-4309: Cost optimization for serviceM11 - Release 0.14Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/234Adding AWS Group Cache and JSON-Smart Vulnerability Fix2022-02-09T20:59:24ZMarc Burnie [AWS]Adding AWS Group Cache and JSON-Smart Vulnerability FixAdding group cache to aws search and patching JSON-smart vulnerabilityAdding group cache to aws search and patching JSON-smart vulnerabilityM11 - Release 0.14JoeGregMarc Burnie [AWS]Okoun-Ola Fabien HouetoJoehttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/232GONRG-4092 Migrate Search Service to anthos2022-02-09T09:37:19ZAnastasiia GelmutGONRG-4092 Migrate Search Service to anthos## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
---
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud p...## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
---
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES]
## What is the new/expected behavior?
Migrate Search Service to anthos
## Have you added/updated Unit Tests and Integration Tests?
yesM11 - Release 0.14Riabokon Stanislav(EPAM)[GCP]Andrei Dalhikh [EPAM/GC]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/230Update search service to adopt new type of kind to support search across mult...2023-06-07T10:32:33ZZhibin MaiUpdate search service to adopt new type of kind to support search across multi-kindsIssue:[73](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/73/)
As part of the solution to support multi-kinds, in this MR, we update search service to adopt new type of kind to support search across multi-k...Issue:[73](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/73/)
As part of the solution to support multi-kinds, in this MR, we update search service to adopt new type of kind to support search across multi-kindsM11 - Release 0.14Zhibin MaiZhibin Maihttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/227Update .gitlab-ci.yml2023-08-18T22:05:12ZNethi Saran KumarUpdate .gitlab-ci.ymlM11 - Release 0.14Shrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/226Update .gitlab-ci.yml2023-08-31T18:46:34ZNethi Saran KumarUpdate .gitlab-ci.ymlM11 - Release 0.14Shrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/224Update .gitlab-ci.yml2022-09-16T00:45:49ZShrikant GargUpdate .gitlab-ci.ymlchange in gitlab yaml. only specific to ibmchange in gitlab yaml. only specific to ibmM11 - Release 0.14Shrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/223Update search_openapi.yaml2023-08-18T22:05:15ZSmitha ManjunathUpdate search_openapi.yamlRemoved un-used APIs from documentationRemoved un-used APIs from documentationM11 - Release 0.14Smitha ManjunathSmitha Manjunathhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/219Handle path prefix in elasticsearch url2023-08-18T22:05:16ZVibhuti Sharma [Microsoft]Handle path prefix in elasticsearch urlAzure tests are failing due to update in Azure elasticsearch endpoint. This MR contains a short term fix in the ITs to handle the new elasticsearch url, a long term fix in the service code will be taken up later.
For more context refer ...Azure tests are failing due to update in Azure elasticsearch endpoint. This MR contains a short term fix in the ITs to handle the new elasticsearch url, a long term fix in the service code will be taken up later.
For more context refer https://community.opengroup.org/osdu/platform/system/indexer-service/-/issues/53M11 - Release 0.14Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/187fix dependencies issues2023-08-18T22:05:43ZYauheni Lesnikaufix dependencies issuesIssue: https://community.opengroup.org/osdu/platform/system/search-service/-/issues/79Issue: https://community.opengroup.org/osdu/platform/system/search-service/-/issues/79M11 - Release 0.14Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/184Improve bad request response messages(GONRG-3718)2023-08-18T22:05:48ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comImprove bad request response messages(GONRG-3718)# Description:
In case when elasticsearch is acknowledging a request as a "bad request", we will look to suppressed exception and if there will be a response body with the fail reason we will transfer it to the user.<br/>
Issue:https://c...# Description:
In case when elasticsearch is acknowledging a request as a "bad request", we will look to suppressed exception and if there will be a response body with the fail reason we will transfer it to the user.<br/>
Issue:https://community.opengroup.org/osdu/platform/system/search-service/-/issues/70
# How to test:
Perform queries that do not fit existing index mapping at elasticsearch.<br/>
Query:
~~~
{
"kind": "{{data-partition-id}}:wks:master-data--Well:*.*.*",
"query": "nested(data.NameAliases, (AliasName:\"L10-14\" AND AliasNameTypeID:\"osdu:reference-data--AliasNameType:WELL_NAME:\"))"
}
~~~
Mapping:
~~~
"NameAliases": {
"type": "flattened"
},
~~~
Response:
~~~
{
"code": 400,
"reason": "Bad Request",
"message": "failed to create query: [nested] failed to find nested object under path [data.NameAliases]"
}
~~~
# Changes include:
- [ ] Refactor (a non-breaking change that improves code maintainability).
- [ ] Bugfix (a non-breaking change that solves an issue).
- [x] New feature (a non-breaking change that adds functionality).
- [ ] Breaking change (a change that is not backward-compatible and/or changes current functionality).
# Changes in:
- [x] GCP
- [x] Azure
- [x] AWS
- [x] IBM
# Dev Checklist:
- [ ] Added Unit Tests, wherever applicable.
- [x] Updated the Readme, if applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.M11 - Release 0.14Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/297Cherry-pick 'Azure update jackson dependencies' into release/0.152022-06-22T16:41:04ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Azure update jackson dependencies' into release/0.15Original MR: !296Original MR: !296M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/296Azure update jackson dependencies.2022-06-22T15:32:57ZErnesto GutierrezAzure update jackson dependencies.## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud p...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [X] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- NO
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful information
Update jackson-databind version from 2.13.2 -> 2.13.2.2 in azure folder.M12 - Release 0.15Ernesto GutierrezErnesto Gutierrezhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/295Cherry-pick 'Upgrade Core IBM Library for Release 0.15' into release/0.152022-06-17T16:25:10ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Upgrade Core IBM Library for Release 0.15' into release/0.15Original MR: !293Original MR: !293M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/293Upgrade Core IBM Library for Release 0.152022-06-17T15:28:47ZDavid Diederichd.diederich@opengroup.orgUpgrade Core IBM Library for Release 0.15This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any...This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any library that is older than the previous release will be left as-is, since the upgrade is likely to be more complicated.
Furthermore, the upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: 4494cbdf7d1f2fd4fedbfa3b902b129087bb6e15
Maven: 0.16.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/integration-tests/ |
| ------------------------------------------------------- | ---------------- | -------------------------- |
| core-lib-azure | 0.15.2 | 0.13.0-rc6 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.15.0 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.15.0 | 0.15.0 |
| os-core-lib-ibm | 0.15.1 | 0.15.1 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.2, 2.13.2.2 | 2.13.2.2 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-slf4j-impl | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2 |
```
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
```
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade
SHA: 5ae9a9f91c19675771bfe10ae1df2467c3db29ef
Maven: 0.16.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/integration-tests/ |
| ------------------------------------------------------- | ---------------- | -------------------------- |
| core-lib-azure | 0.15.2 | 0.13.0-rc6 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.15.0 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.15.0 | 0.15.0 |
| os-core-lib-ibm | 0.15.2 | 0.15.2 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.2, 2.13.2.2 | 2.13.2.2 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-slf4j-impl | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2 |
```
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
```M12 - Release 0.15https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/292Cherry-pick 'Upgrade First Party Library Dependencies for Release 0.15' into ...2022-06-16T14:50:14ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Upgrade First Party Library Dependencies for Release 0.15' into release/0.15Original MR: !281Original MR: !281M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/289Cherry-pick 'jackson version update' into release/0.152022-06-14T14:56:28ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'jackson version update' into release/0.15Original MR: !288Original MR: !288M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/288jackson version update2022-09-16T02:12:25ZMorris Estepajackson version updatecommit 0fb10b8836456248eb186248e1922a1629d8475a
Author: Morris Estepa <estepamo@amazon.com>
Date: 1654875447 -0500
jackson version update.commit 0fb10b8836456248eb186248e1922a1629d8475a
Author: Morris Estepa <estepamo@amazon.com>
Date: 1654875447 -0500
jackson version update.M12 - Release 0.15Morris EstepaMorris Estepahttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/281Upgrade First Party Library Dependencies for Release 0.152022-06-16T00:37:36ZDavid Diederichd.diederich@opengroup.orgUpgrade First Party Library Dependencies for Release 0.15This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any...This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any library that is older than the previous release will be left as-is, since the upgrade is likely to be more complicated.
Furthermore, the upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: 911b74b8ec3a8b21a8383cc83abe836063667c05
Maven: 0.15.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/integration-tests/ |
| ------------------------------------------------------- | ---------- | -------------------------- |
| core-lib-azure | 0.15.0-rc6 | 0.13.0-rc6 |
| core-lib-gcp | 0.15.0-rc3 | |
| os-core-lib-aws | 0.14.0 | 0.14.0-rc2 |
| obm | 0.15.0-rc5 | |
| oqm | 0.15.0-rc2 | |
| os-core-common | 0.15.0-rc3 | 0.15.0-rc3 |
| os-core-lib-ibm | 0.15.0-rc2 | 0.15.0-rc2 |
| osm | 0.15.0-rc5 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.11.4 | 2.11.4 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-slf4j-impl | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2 |
```
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
```
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade
SHA: d4c8fa314552c595d99a9dbe719a8c2b8d41960e
Maven: 0.15.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/integration-tests/ |
| ------------------------------------------------------- | ------ | -------------------------- |
| core-lib-azure | 0.15.2 | 0.13.0-rc6 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.15.0 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.15.0 | 0.15.0 |
| os-core-lib-ibm | 0.15.1 | 0.15.1 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.11.4 | 2.13.2.2, 2.11.4 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-slf4j-impl | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2 |
```
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
```M12 - Release 0.15https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/277Update os-core-lib2023-08-18T22:04:40ZHarsheet ShahUpdate os-core-lib## Type of change
- [ ] Bug Fix No
- [ ] Feature No
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO] No
## Does this introduce a change in the...## Type of change
- [ ] Bug Fix No
- [ ] Feature No
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO] No
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS No
- [ ] Azure No
- [ ] GCP No
- [ ] IBM No
## Does this introduce a breaking change?
- [YES/NO] NO
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful information
Updating version of os-core-lib-azureM12 - Release 0.15Harsheet ShahHarsheet Shah