Search merge requestshttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests2022-07-11T11:37:55Zhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/305fix gcp int test readme2022-07-11T11:37:55ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comfix gcp int test readmeM13 - Release 0.16Rustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/303ByIntersectionQuery, WithinPolygonQuery2022-07-18T10:37:31ZVivek OjhaByIntersectionQuery, WithinPolygonQuery## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud p...## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES/NO]
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationVivek OjhaVivek Ojhahttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/302Remove non-functional and previously deprecated CCS endpoint from Search service2022-09-16T07:33:48ZNeelesh ThakurRemove non-functional and previously deprecated CCS endpoint from Search serviceRemove non-functional and previously deprecated (issue: [71](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/71)) CCS endpoint from Search service. The endpoint was incorrectly imported from OpenDES and it's ...Remove non-functional and previously deprecated (issue: [71](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/71)) CCS endpoint from Search service. The endpoint was incorrectly imported from OpenDES and it's not applicable for OSDU Data Platform.
## Type of change
- [ ] Bug Fix
- [X] Feature
Resolves the issue: [96](https://community.opengroup.org/osdu/platform/system/search-service/-/issues/96)
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [X] Azure
- [X] GCP
- [X] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
- [NO]
## What is the new/expected behavior?
- [NO]
-
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Any other useful informationM13 - Release 0.16Neelesh ThakurNeelesh Thakurhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/301add support for multi-polygon intersection query2023-08-18T22:04:27ZNeelesh Thakuradd support for multi-polygon intersection query## Type of change
- [ ] Bug Fix
- [X] Feature
Gitlab issue https://community.opengroup.org/osdu/platform/system/home/-/issues/94
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud p...## Type of change
- [ ] Bug Fix
- [X] Feature
Gitlab issue https://community.opengroup.org/osdu/platform/system/home/-/issues/94
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [X] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
YES
## Any other useful informationM13 - Release 0.16Neelesh ThakurNeelesh Thakurhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/300GONRG-5228: Added .dockerignore and .gitattributes2023-08-18T22:04:29ZKrisztian Molnar (EPAM)GONRG-5228: Added .dockerignore and .gitattributes## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationM13 - Release 0.16Krisztian Molnar (EPAM)Krisztian Molnar (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/299Aws ibm helm fix2022-06-29T08:51:19ZAnuj GuptaAws ibm helm fix## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [ ] Azure
- [ ] GCP
- [X] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Search service in through helm charts goes into crashloop
## What is the new/expected behavior?
Search service should get started
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationAnuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/298optimize queries for data root user2023-06-27T12:03:19ZNeelesh Thakuroptimize queries for data root userOptimizes queries for data root user. If a data root user is a member of few thousand group (>=5K) than termsInSet query adds lot of pressure on Search backends' search queue. Most of the time is spent on this particular clause. Instead,...Optimizes queries for data root user. If a data root user is a member of few thousand group (>=5K) than termsInSet query adds lot of pressure on Search backends' search queue. Most of the time is spent on this particular clause. Instead, we can rely on Entitlements and check if a user belongs to data root group.M13 - Release 0.16Neelesh ThakurNeelesh Thakurhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/297Cherry-pick 'Azure update jackson dependencies' into release/0.152022-06-22T16:41:04ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Azure update jackson dependencies' into release/0.15Original MR: !296Original MR: !296M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/296Azure update jackson dependencies.2022-06-22T15:32:57ZErnesto GutierrezAzure update jackson dependencies.## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud p...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [X] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- NO
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful information
Update jackson-databind version from 2.13.2 -> 2.13.2.2 in azure folder.M12 - Release 0.15Ernesto GutierrezErnesto Gutierrezhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/295Cherry-pick 'Upgrade Core IBM Library for Release 0.15' into release/0.152022-06-17T16:25:10ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Upgrade Core IBM Library for Release 0.15' into release/0.15Original MR: !293Original MR: !293M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/294Fix for Swagger Authorization Issue2023-08-18T22:04:30ZVibhuti Sharma [Microsoft]Fix for Swagger Authorization Issue## Type of change
- Bug Fix
Issue link -
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/95
## Does this introduce a change in the core logic?
- Yes, it is a change in search-core module.
## Does this int...## Type of change
- Bug Fix
Issue link -
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/95
## Does this introduce a change in the core logic?
- Yes, it is a change in search-core module.
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- It is a change in search-core module, so the change will be introduced in all CSPs.
## Does this introduce a breaking change?
- NO
## What is the current behavior?
Querying any API through Swagger results in 403 response. This is due to the Authorization header not being picked up. The same API returns expected response through Postman or Curl.
## What is the new/expected behavior?
Querying API through Swagger is returning expected response.
## Have you added/updated Unit Tests and Integration Tests?
No
## Any other useful information
In all other services, the authorizationScope selected for Swagger is "Authorization" ([code link](https://community.opengroup.org/osdu/platform/system/storage/-/blob/azure/m10-master/storage-core/src/main/java/org/opengroup/osdu/storage/swagger/SwaggerDocumentationConfig.java#L88)). However, in search it is "JWT" ([code link](https://community.opengroup.org/osdu/platform/system/search-service/-/blob/master/search-core/src/main/java/org/opengroup/osdu/search/swagger/SwaggerDocumentationConfig.java#L66))
Due to this, calling APIs through Swagger is resulting in 403 response. This MR aims at fixing this issue.M13 - Release 0.16Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/293Upgrade Core IBM Library for Release 0.152022-06-17T15:28:47ZDavid Diederichd.diederich@opengroup.orgUpgrade Core IBM Library for Release 0.15This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any...This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any library that is older than the previous release will be left as-is, since the upgrade is likely to be more complicated.
Furthermore, the upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: 4494cbdf7d1f2fd4fedbfa3b902b129087bb6e15
Maven: 0.16.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/integration-tests/ |
| ------------------------------------------------------- | ---------------- | -------------------------- |
| core-lib-azure | 0.15.2 | 0.13.0-rc6 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.15.0 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.15.0 | 0.15.0 |
| os-core-lib-ibm | 0.15.1 | 0.15.1 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.2, 2.13.2.2 | 2.13.2.2 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-slf4j-impl | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2 |
```
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
```
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade
SHA: 5ae9a9f91c19675771bfe10ae1df2467c3db29ef
Maven: 0.16.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/integration-tests/ |
| ------------------------------------------------------- | ---------------- | -------------------------- |
| core-lib-azure | 0.15.2 | 0.13.0-rc6 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.15.0 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.15.0 | 0.15.0 |
| os-core-lib-ibm | 0.15.2 | 0.15.2 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.2, 2.13.2.2 | 2.13.2.2 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-slf4j-impl | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2 |
```
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
```M12 - Release 0.15https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/292Cherry-pick 'Upgrade First Party Library Dependencies for Release 0.15' into ...2022-06-16T14:50:14ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Upgrade First Party Library Dependencies for Release 0.15' into release/0.15Original MR: !281Original MR: !281M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/291Fix for Swagger Authorization Issue.2022-06-16T10:18:14ZVibhuti Sharma [Microsoft]Fix for Swagger Authorization Issue.## Type of change
Bug Fix
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/95
## Does this introduce a change in the core logic...## Type of change
Bug Fix
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/95
## Does this introduce a change in the core logic?
- No change in core logic. It is a change in swagger.
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- The change is in search-core module, so it affects all CSPs.
## Does this introduce a breaking change?
- No
## What is the current behavior?
Querying any API through Swagger results in 403 response. This is due to the Authorization header not being picked up.
## What is the new/expected behavior?
Querying API through Swagger is returning expected response.
## Have you added/updated Unit Tests and Integration Tests?
No
## Any other useful information
In all other services, the authorizationScope selected for Swagger is "Authorization" ([code link](https://community.opengroup.org/osdu/platform/system/storage/-/blob/azure/m10-master/storage-core/src/main/java/org/opengroup/osdu/storage/swagger/SwaggerDocumentationConfig.java#L88)).
However, in search it is "JWT" ([code link](https://community.opengroup.org/osdu/platform/system/search-service/-/blob/master/search-core/src/main/java/org/opengroup/osdu/search/swagger/SwaggerDocumentationConfig.java#L66))
Due to this, calling APIs through Swagger is resulting in 403 response. This MR aims at fixing this issue.Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/290Added OPA Translation integration2023-01-27T20:41:18ZMaciej HanszkeAdded OPA Translation integrationThis feature is related to [Integrate search with policy translate API](https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/issues/55) issue
Before merging, please make sure that [Added OPA Translation integrat...This feature is related to [Integrate search with policy translate API](https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/issues/55) issue
Before merging, please make sure that [Added OPA Translation integration os-common feature branch](https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/161) is merged to master.
This merge request is related to the OPA Translation feature server, that was created in @hon.lianhung merge request. This feature contains reference usage of the OPA server translate response, and concatenating it with actual query.
* Bumped the commons version
* Added translate endpoint usage
* Added query concatenationM14 - Release 0.17Dadong ZhouMaciej HanszkeDadong Zhouhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/289Cherry-pick 'jackson version update' into release/0.152022-06-14T14:56:28ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'jackson version update' into release/0.15Original MR: !288Original MR: !288M12 - Release 0.15David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/288jackson version update2022-09-16T02:12:25ZMorris Estepajackson version updatecommit 0fb10b8836456248eb186248e1922a1629d8475a
Author: Morris Estepa <estepamo@amazon.com>
Date: 1654875447 -0500
jackson version update.commit 0fb10b8836456248eb186248e1922a1629d8475a
Author: Morris Estepa <estepamo@amazon.com>
Date: 1654875447 -0500
jackson version update.M12 - Release 0.15Morris EstepaMorris Estepahttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/286GONRG-5051: refactor dev2 pipeline2023-08-18T22:04:32ZNastassia Rabeichykava (EPAM)GONRG-5051: refactor dev2 pipelineM13 - Release 0.16https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/283GONRG-5061-refactor-comm-pipe2023-08-18T22:04:34ZSiarhei Symanovich (EPAM)GONRG-5061-refactor-comm-pipeupdated community pipelineupdated community pipelineM13 - Release 0.16Siarhei Symanovich (EPAM)Siarhei Symanovich (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/282Preship pipeline [GONRG-5050]2023-08-18T22:04:35ZMikhail Piatliou (EPAM)Preship pipeline [GONRG-5050]GONRG-5050: updated ref to common pipeline for testing preship pipeline, minor helm vars refactoringGONRG-5050: updated ref to common pipeline for testing preship pipeline, minor helm vars refactoringM13 - Release 0.16Mikhail Piatliou (EPAM)Mikhail Piatliou (EPAM)