Indexer merge requestshttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests2020-07-16T23:03:22Zhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/11Azure - (4/4) - Adding missing context path for indexer2020-07-16T23:03:22ZDuvelis CaraoAzure - (4/4) - Adding missing context path for indexer**This only impacts Azure implementation.**
This MR is part of group of MRs with dependencies between them
0. Update infrastructure (Azure / osdu-infrastructure) to have reference to the new URLs (https://github.com/Azure/osdu-infr...**This only impacts Azure implementation.**
This MR is part of group of MRs with dependencies between them
0. Update infrastructure (Azure / osdu-infrastructure) to have reference to the new URLs (https://github.com/Azure/osdu-infrastructure/pull/23)
1. Adding missing context path for entitlements.
2. Adding missing context path for legal.
3. Adding missing context path for storage.
4. Adding missing context path for indexer
After merging this MR, the new indexer URL will be:
https://{host}**/api/indexer/v2/**
Before merging this MR:
- Please make sure the dependent MR is done: https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/33
--------
This PR is related to 6 other requests for changing a URL structure and adding in context paths for services.
1. osdu-infrastructure 1/6 PR https://github.com/Azure/osdu-infrastructure/pull/23
1. CI-CD Pipelines 2/6 This PR
1. Entitlements Azure 3/6 https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements-azure/-/merge_requests/11
1. Legal 4/6 https://community.opengroup.org/osdu/platform/security-and-compliance/legal/-/merge_requests/32
1. Storage 5/6 https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/33
1. Indexer 6/6 https://community.opengroup.org/osdu/platform/system/indexer-service
They are all required and any one but not the other will break builds and tests across the entire ecosystem for Azure.M1 - Release 0.1ethiraj krishnamanaiduDania Kodeih (Microsoft)Daniel Schollethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/256M8 Log4j2 Fix2021-12-23T05:21:38ZAryaan SinghM8 Log4j2 FixM8 Log4j2 FixM8 Log4j2 FixAryaan SinghAryaan Singhhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/334Azure update jackson dependencies.2022-06-22T15:33:56ZErnesto GutierrezAzure update jackson dependencies.Update jackson-databind version from 2.11.4 -> 2.13.2.2 in azure folder.Update jackson-databind version from 2.11.4 -> 2.13.2.2 in azure folder.M12 - Release 0.15Ernesto GutierrezErnesto Gutierrezhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/349Merge branch 'fix-jackson-version' into 'master'2022-07-27T01:01:25ZErnesto GutierrezMerge branch 'fix-jackson-version' into 'master'Fix jackson version
See merge request osdu/platform/system/indexer-service!348
(cherry picked from commit da994e110ceecdaa9a111844a7c35cfeaf9759a5)
0d7dca81 Fixed jackson version
71ee727a Fixed test jackson versionFix jackson version
See merge request osdu/platform/system/indexer-service!348
(cherry picked from commit da994e110ceecdaa9a111844a7c35cfeaf9759a5)
0d7dca81 Fixed jackson version
71ee727a Fixed test jackson versionM12 - Release 0.15Ernesto GutierrezErnesto Gutierrezhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/360Cherry pick spring-webmvc to release/0.162022-08-10T17:31:38ZMorris EstepaCherry pick spring-webmvc to release/0.16spring-webmvc upgrade
See merge request osdu/platform/system/indexer-service!356
(cherry picked from commit 1e0671951e90972b2561633bc23d5e1c008dca77)
5af37ab7 Squashed commit of the following
b47dda9d Merge branch 'master' into 'aws-...spring-webmvc upgrade
See merge request osdu/platform/system/indexer-service!356
(cherry picked from commit 1e0671951e90972b2561633bc23d5e1c008dca77)
5af37ab7 Squashed commit of the following
b47dda9d Merge branch 'master' into 'aws-integration'M13 - Release 0.16Morris EstepaMorris Estepahttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/348Fix jackson version2022-09-15T23:22:07ZDmitrii Novikov (EPAM)Fix jackson versionM12 - Release 0.15Dmitrii Novikov (EPAM)Dmitrii Novikov (EPAM)https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/356spring-webmvc upgrade2022-09-16T02:12:09ZMorris Estepaspring-webmvc upgradecommit edf4e19b
Author: Morris Estepa <estepamo@amazon.com>
Date: Thu Jul 28 2022 17:21:45 GMT-0500 (Central Daylight Time)
spring-webmvc upgradecommit edf4e19b
Author: Morris Estepa <estepamo@amazon.com>
Date: Thu Jul 28 2022 17:21:45 GMT-0500 (Central Daylight Time)
spring-webmvc upgradeM13 - Release 0.16Morris EstepaMorris Estepahttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/169Added new version info endpoint (GONRG-2681)2022-09-16T08:49:55ZDmitrii Novikov (EPAM)Added new version info endpoint (GONRG-2681)## Type of change
- [ ] Bug Fix
- [x] Feature
osdu/platform/system/lib/core/os-core-common#47
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so whic...## Type of change
- [ ] Bug Fix
- [x] Feature
osdu/platform/system/lib/core/os-core-common#47
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] IBM
## Does this introduce a breaking change?
- [YES]
## What is the current behavior?
Provides info about maven build and gitM8 - Release 0.11Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/393Upgrade Gson2022-10-06T01:32:19ZXiangliang MengUpgrade Gsoncommit e5cb47b2
Author: David Meng <xlmeng@amazon.com>
Date: Mon Sep 26 2022 17:02:59 GMT-0400 (Eastern Daylight Time)
Upgrade Gsoncommit e5cb47b2
Author: David Meng <xlmeng@amazon.com>
Date: Mon Sep 26 2022 17:02:59 GMT-0400 (Eastern Daylight Time)
Upgrade GsonM14 - Release 0.17Okoun-Ola Fabien HouetoXiangliang MengOkoun-Ola Fabien Houetohttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/412whitesource-update2022-11-23T15:54:25ZMadinabonu Alisherovawhitesource-updatewhitesource indexer updateswhitesource indexer updatesM15 - Release 0.18https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/420added changes to introduce the azure_code_coverage job2022-11-30T12:43:27Zshivani karipeadded changes to introduce the azure_code_coverage job* This change will fix the azure code coverage job and produce the code coverage results
* Jacoco plugin is used for the code coverage
issue ref: https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provis...* This change will fix the azure code coverage job and produce the code coverage results
* Jacoco plugin is used for the code coverage
issue ref: https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/issues/244M15 - Release 0.18shivani karipeshivani karipehttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/297Akprasad/unittest util2022-12-13T23:34:50ZAkanksha PrasadAkprasad/unittest utilUnit tests for some classes in util and service to increase code coverageUnit tests for some classes in util and service to increase code coverageM16 - Release 0.19Akanksha PrasadAkanksha Prasadhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/436Moving the azure bootstrap config file to right package2022-12-14T09:46:48ZNaga Aneesh MylavarapuMoving the azure bootstrap config file to right packageIn the akprasad/unittest-util PR that got merged into main, the AzureBootstrapConfig file got moved to a wrong package causing indexer azure application to fail. This PR is raised to fix this issue and move the file to the right package.In the akprasad/unittest-util PR that got merged into main, the AzureBootstrapConfig file got moved to a wrong package causing indexer azure application to fail. This PR is raised to fix this issue and move the file to the right package.M16 - Release 0.19Naga Aneesh MylavarapuNaga Aneesh Mylavarapuhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/450Adding retry for 502 and 503 bad gateway error2023-02-11T02:17:14ZHarshika DhootAdding retry for 502 and 503 bad gateway errorThis PR is to make our service ITs robust. We have observed lot of transient server errors like service unavailable and bad gw . We have added retries in those cases. The functionality doesn't change. The retries in case of transient err...This PR is to make our service ITs robust. We have observed lot of transient server errors like service unavailable and bad gw . We have added retries in those cases. The functionality doesn't change. The retries in case of transient errors and exceptions make it more resilient.M16 - Release 0.19Harshika DhootHarshika Dhoothttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/474Merge AWS2023-02-20T11:54:41ZAbhishek PatilMerge AWScommit bbcc6995
Author: Abhay <bios@amazon.com>
Date: Fri Dec 02 2022 10:44:20 GMT-0800 (Pacific Standard Time)
upgrade dependencies - oscorelib updated to latest versioncommit bbcc6995
Author: Abhay <bios@amazon.com>
Date: Fri Dec 02 2022 10:44:20 GMT-0800 (Pacific Standard Time)
upgrade dependencies - oscorelib updated to latest versionM17 - Release 0.20Okoun-Ola Fabien HouetoYash DholakiaOkoun-Ola Fabien Houetohttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/506Upgraded azure lib to 20-rc5 for connected outer service endppoint versions2023-03-16T09:15:36ZDeepa KumariUpgraded azure lib to 20-rc5 for connected outer service endppoint versionsUpdated the core lib azure version to the one containing implementation of elastic endpoint versionsUpdated the core lib azure version to the one containing implementation of elastic endpoint versionsM17 - Release 0.20Deepa KumariDeepa Kumarihttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/469eliminate security vulnerabilities for indexer-core and indexer-azure2023-03-23T18:55:42ZYauheni Lesnikaueliminate security vulnerabilities for indexer-core and indexer-azureM17 - Release 0.20Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/511add validation and ignore out of order message when kind is updated2023-03-29T15:30:50ZNeelesh Thakuradd validation and ignore out of order message when kind is updatedUsers have reported issue with data duplication with following scenario:
1. Trigger a re-index job for kinds: both raw and WKS kind at the same time
2. The triggering of the reindexing on raw kind also triggered WKS service to recreate ...Users have reported issue with data duplication with following scenario:
1. Trigger a re-index job for kinds: both raw and WKS kind at the same time
2. The triggering of the reindexing on raw kind also triggered WKS service to recreate the WKS instances derived from them
3. The target schema mapping for these raw records had been updated (e.g. version 1.0 to 1.1), meaning the new versions of these records created by WKS changed the schema.
4. Index therefore received 2 events for the same WKS record instances at similar times, one to re-index the original and another to create the new one
5. If the one to create the new instance for WKS was processed first that would lead to duplicates appearing.
This changes-set adds validation to avoid duplication by ignoring the event when kind is updated in such cases.M17 - Release 0.20https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/512tweak parameters to enhance reindex performance2023-03-29T22:02:22ZNeelesh Thakurtweak parameters to enhance reindex performance- Use max 'limit' param value (1000) to fetch record-ids from Storage for kind.
- Batch 1k record-ids to 50 (same limit as Storage PUT API record-changed event).
With these changes, we see 5x performance improvements on reindex API.- Use max 'limit' param value (1000) to fetch record-ids from Storage for kind.
- Batch 1k record-ids to 50 (same limit as Storage PUT API record-changed event).
With these changes, we see 5x performance improvements on reindex API.M17 - Release 0.20https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/445Vulnerability fix ibm indexer service2023-03-30T08:07:20ZPintu GuptaVulnerability fix ibm indexer serviceFollowing CVE has been fix into this MR :
| cve | link |
|----------------|-------------------------------------------------|
| CVE-2022-42003 | https://nvd.nist.gov/vuln/detail/CVE-2...Following CVE has been fix into this MR :
| cve | link |
|----------------|-------------------------------------------------|
| CVE-2022-42003 | https://nvd.nist.gov/vuln/detail/CVE-2022-42003 |
| CVE-2022-42004 | https://nvd.nist.gov/vuln/detail/CVE-2022-42004 |
| CVE-2022-25857 | https://nvd.nist.gov/vuln/detail/CVE-2022-25857 |
| CVE-2022-42252 | https://nvd.nist.gov/vuln/detail/CVE-2022-42252 |M16 - Release 0.19Pintu GuptaPintu Gupta