Search merge requestshttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests2023-08-18T22:13:43Zhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/58GONRG-1125: variables OSDU_GCP_REDIS_SEARCH_PORT and...2023-08-18T22:13:43ZAliaksandr Lubouski (EPAM)GONRG-1125: variables OSDU_GCP_REDIS_SEARCH_PORT and...GONRG-1125: variables OSDU_GCP_REDIS_SEARCH_PORT and OSDU_GCP_SPRING_PROFILES_ACTIVE moved to ci-cd-pipelines cloudrun from searchGONRG-1125: variables OSDU_GCP_REDIS_SEARCH_PORT and OSDU_GCP_SPRING_PROFILES_ACTIVE moved to ci-cd-pipelines cloudrun from searchM1 - Release 0.1https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/57copy test parent pom to int test path2023-08-18T22:13:44ZMatt Wisecopy test parent pom to int test pathM1 - Release 0.1https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/56Move Search Config out of os-core-common (GONRG-744)2023-08-18T22:13:46ZArtem Dobrynin (EPAM)Move Search Config out of os-core-common (GONRG-744)## Type of change
- [X] Feature
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [X] Azure
- [X] GCP
- [X] IBM
## Does th...## Type of change
- [X] Feature
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [X] Azure
- [X] GCP
- [X] IBM
## Does this introduce a breaking change?
- [YES]
The breaking change was introduced in [os-core-common](https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/34)
The config from common lib does not support search- and indexer-related values. These values were moved to `org.opengroup.osdu.search.config.SearchConfigurationProperties`
## What is the current behavior?
In this ticket the new separate config `org.opengroup.osdu.search.config.SearchConfigurationProperties` was created. It is managed by `@ConfigurationProperties`.
All occurrences of the old config were replaced by new config
## Have you added/updated Unit Tests and Integration Tests?
- [YES]
## Any other useful information
depends on:
https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/34M1 - Release 0.1Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/55Fix whitesource2023-08-18T22:13:48ZPavel BachylaFix whitesource## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- No
## Does this introduce a change in the cloud provide...## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- No
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- No
## What is the current behavior?
N/A
## What is the new/expected behavior?
N/A
## Have you added/updated Unit Tests and Integration Tests?
N/A
## Any other useful information
Fix Major/Critical/Blocker WhiteSource vulnerabilities except those related to ElasticSearch version limitations and log4j due to incompatibilities with other librariesM1 - Release 0.1ethiraj krishnamanaiduNeelesh ThakurSherman Yangethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/54Updated Helm Chart2023-08-18T22:13:49ZDaniel SchollUpdated Helm ChartChanging Default Sizing of Standard Azure Deployment. https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/42Changing Default Sizing of Standard Azure Deployment. https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/42M1 - Release 0.1Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/53Removed unhardcode repositories and distribution management from all poms (GO...2023-08-18T22:13:51ZRiabokon Stanislav(EPAM)[GCP]Removed unhardcode repositories and distribution management from all poms (GONRG-1056)## Type of change
- [ ] Bug Fix
- [X] Feature
ADR: https://community.opengroup.org/osdu/platform/system/home/-/issues/55
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider...## Type of change
- [ ] Bug Fix
- [X] Feature
ADR: https://community.opengroup.org/osdu/platform/system/home/-/issues/55
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [X] Azure
- [X] GCP
- [X] IBM
## Does this introduce a breaking change?
- [YES]
## What is the new/expected behavior?
This MR brings changes to POMs (root, azure, gcp) to improve (unhardcode) the way how repositories are being pointed. It now uses set of properties defined in the `.mvn/community-maven.settings.xml`
## Have you added/updated Unit Tests and Integration Tests?
- [YES]
## Any other useful informationM1 - Release 0.1Dmitriy RudkoRostislav Dublin (EPAM)Dmitriy Rudkohttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/51Azure SDKs Upgrade and Dependency Management2023-08-18T22:13:52ZAbhishek PatilAzure SDKs Upgrade and Dependency Management## All Submissions:
-------------------------------------
* [YES] Have you followed our code review [guidelines](https://github.com/microsoft/code-with-engineering-playbook/blob/master/pull-requests/code-reviews/readme.md)?
* [YES] Have ...## All Submissions:
-------------------------------------
* [YES] Have you followed our code review [guidelines](https://github.com/microsoft/code-with-engineering-playbook/blob/master/pull-requests/code-reviews/readme.md)?
* [YES] Have you added an explanation of what your changes do and why you'd like us to include them?
* [YES] I have updated the documentation accordingly.
* [NA] I have added tests to cover my changes.
* [YES] All new and existing tests passed.
* [YES] My code follows the code style of this project.
* [NO] I ran lint checks locally prior to submission.
## What is the current behavior?
-------------------------------------
- Old version of Azure SDKs are used in service.
- Versions of dependencies which are common across all OSDU services are not consistent/same in all OSDU services.<!-- Please describe the current behavior that you are modifying, or link to a relevant issue. -->
Issue: https://dev.azure.com/msazure/One/_workitems/edit/8708950
## What is the new behavior?
-------------------------------------
- All Azure SDKs are upgraded to latest stable version.
- Common dependencies are inherited from core-lib-azure as managed dependencies. This will make sure that version info of those dependencies are inherited from core-lib-azure. All OSDU services using same version of core-lib-azure will automatically use same versions for all those dependencies.<!-- Please describe the behavior or changes that are being added by this PR. -->
## Does this introduce a breaking change?
-------------------------------------
- [NO]
<!-- If this introduces a breaking change, please describe the impact and migration path for existing applications below. -->
## Any relevant logs, error output, etc?
-------------------------------------
(If it’s long, please paste to https://ghostbin.com/ and insert the link here.)
## Other information
-------------------------------------
<!-- Any other information that is important to this PR such as screenshots of how the component looks before and after the change. -->M1 - Release 0.1Abhishek PatilAbhishek Patilhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/49Migrate search to cloudrun2023-08-18T22:13:54ZOleksandr Kosse (EPAM)Migrate search to cloudrunChanged gitlab-ci.yml to include clodrun pipeline.Changed gitlab-ci.yml to include clodrun pipeline.M1 - Release 0.1https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/47Fixed Pipeline Environment2023-08-18T22:13:56ZDaniel SchollFixed Pipeline EnvironmentChanged dev to demo.Changed dev to demo.M1 - Release 0.1Daniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/46Add redis cache for azure provider2023-08-18T22:13:57ZAliaksei DarafeyeuAdd redis cache for azure provider## Type of change
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] Azure
## Does this introduce a breaking change?
- [...## Type of change
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] Azure
## Does this introduce a breaking change?
- [NO]
## What is the new/expected behavior?
adds ability use redis or inMemory for azure provider
## has dependency on OS Core Lib Azure:
https://community.opengroup.org/osdu/platform/system/lib/cloud/azure/os-core-lib-azure/-/merge_requests/36M1 - Release 0.1ethiraj krishnamanaiduNitin-slbNeelesh ThakurSherman YangPavel BachylaAlok JoshiDuvelis Caraoethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/41Upgrading core-lib-azure version and cleaning up RedisCacheSettingsImpl and i...2023-08-18T22:14:00ZAbhishek PatilUpgrading core-lib-azure version and cleaning up RedisCacheSettingsImpl and its related classes======================= **Change Description** ===================
- Upgraded the version of dependency `core-lib-azure`
- Removed `TenantFactoryImpl` class and using same from `core-lib-azure`
- Removed `RedisCacheSettingsImpl` class an...======================= **Change Description** ===================
- Upgraded the version of dependency `core-lib-azure`
- Removed `TenantFactoryImpl` class and using same from `core-lib-azure`
- Removed `RedisCacheSettingsImpl` class and its related classes as they are not being used anywhere
- Removed dependencies `azure-cosmosdb-spring-boot-starter` and `spring-data-cosmosdb` as there were only used by the above classes which are removed now
======================= **Tests** ======================
- All the existing integration-tests are passing after doing the above changeM1 - Release 0.1Abhishek PatilAbhishek Patilhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/40Update .gitlab-ci.yml2023-08-18T22:14:02ZMatt WiseUpdate .gitlab-ci.ymlM1 - Release 0.1Matt WiseMatt Wisehttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/39Leveraging Azure Service Principle class to utilize from core lib azure2023-08-18T22:14:03Zsatish kumar narganiLeveraging Azure Service Principle class to utilize from core lib azureAdded dependencies for core lib azure and other dependencies related to logbackAdded dependencies for core lib azure and other dependencies related to logbackM1 - Release 0.1Christian LecknerDania Kodeih (Microsoft)Nandu MuralidharanChristian Lecknerhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/38Support for self-signed certificates for ElasticSearch connection (GONRG-546,...2023-08-18T22:14:05ZRiabokon Stanislav(EPAM)[GCP]Support for self-signed certificates for ElasticSearch connection (GONRG-546, GONRG-550)## Type of change
- [ ] Bug Fix
- [X] Feature
https://community.opengroup.org/osdu/platform/system/home/-/issues/52
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/22
## Does this introduce a change in the...## Type of change
- [ ] Bug Fix
- [X] Feature
https://community.opengroup.org/osdu/platform/system/home/-/issues/52
https://community.opengroup.org/osdu/platform/system/search-service/-/issues/22
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [X] Azure
- [X] GCP
- [X] IBM
## Does this introduce a breaking change?
- [YES]
## What is the current behavior?
Search does not support for self-signed certificates for ElasticSearch connection
## What is the new/expected behavior?
To use self-signed certificates for Elastic on non-production environments.
## Have you added/updated Unit Tests and Integration Tests?
-
## Any other useful informationM1 - Release 0.1Dmitriy RudkoRostislav Dublin (EPAM)Dmitriy Rudkohttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/37Enabled slf4j logger, transaction logger and mdcContext2023-08-18T22:14:06ZVibhuti Sharma [Microsoft]Enabled slf4j logger, transaction logger and mdcContext* Enabled slf4j logger, transaction logger and mdc context by updating the version of os-core-lib-azure in pom.xml file and adding the necessary commands in application.properties
* Added exclusions in pom.xml dependencies to enable slf4...* Enabled slf4j logger, transaction logger and mdc context by updating the version of os-core-lib-azure in pom.xml file and adding the necessary commands in application.properties
* Added exclusions in pom.xml dependencies to enable slf4j logger binding without conflict
* Verified locally the reflection of test logs in `Traces` table in AppInsights
* \[YES\] Have you followed our code review [guidelines](https://github.com/microsoft/code-with-engineering-playbook/blob/master/pull-requests/code-reviews/readme.md)?
* \[YES\] Have you added an explanation of what your changes do and why you'd like us to include them?
* \[NO\] I have updated the documentation accordingly.
* \[NA\] I have added tests to cover my changes.
* \[YES\] All new and existing tests passed.
* \[YES\] My code follows the code style of this project.
* \[YES\] I ran lint checks locally prior to submission.M1 - Release 0.1Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/35Disabling AAD auth in search service2023-08-18T22:14:08ZKiran VeerapaneniDisabling AAD auth in search serviceAs Istio AuthN got enabled in R2 services,Disabling AAD authentication using Istio auth property. Added Istio auth Env variable and set to true in helm charts templateAs Istio AuthN got enabled in R2 services,Disabling AAD authentication using Istio auth property. Added Istio auth Env variable and set to true in helm charts templateM1 - Release 0.1https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/34multi-tenancy updates for Search azure2023-08-18T22:15:49ZDuvelis Caraomulti-tenancy updates for Search azureDraft merge requests can't be merged.Draft merge requests can't be merged.M1 - Release 0.1https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/33upgrade springboot to fix whitesoure vulnerabilities2023-08-18T22:16:00ZAliaksei Darafeyeuupgrade springboot to fix whitesoure vulnerabilitiesM1 - Release 0.1ethiraj krishnamanaiduNitin-slbNeelesh ThakurSherman Yangethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/32use env var for code artifact domain. dynamically use current account as repo...2023-08-18T22:16:03ZMatt Wiseuse env var for code artifact domain. dynamically use current account as repo ownerM1 - Release 0.1Matt WiseMatt Wisehttps://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/31Added Azure AKS support for pipelines2023-08-18T22:16:05ZDaniel SchollAdded Azure AKS support for pipelinesM1 - Release 0.1Daniel SchollDaniel Scholl