Indexer merge requestshttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests2023-08-25T22:29:48Zhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/440running the pipelines with azure/m12-master2023-08-25T22:29:48ZNishant Vidyasagarrunning the pipelines with azure/m12-master(cherry picked from commit 1bd4a6e6aaf681ac0b14c12b0c288dd1587258e2)
Conflicts:
.gitlab-ci.yml(cherry picked from commit 1bd4a6e6aaf681ac0b14c12b0c288dd1587258e2)
Conflicts:
.gitlab-ci.ymlhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/670Run integration test2023-12-14T21:13:12ZZhibin MaiRun integration testRun integration testRun integration testZhibin MaiZhibin Maihttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/566Revert "Merge branch 'vulnerabilite-resolve' into 'azure/m16-master'"2023-06-21T08:03:09ZAkshat JoshiRevert "Merge branch 'vulnerabilite-resolve' into 'azure/m16-master'"This reverts merge request !565This reverts merge request !565https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/702Revert "Merge branch 'sbstan/bag-of-words-indexing' into 'master'"2024-01-24T12:01:05ZChad LeongRevert "Merge branch 'sbstan/bag-of-words-indexing' into 'master'"This reverts commit 820860e381079deba98e3885c33f30ff6e629ed9.
Conflicts:
provider/indexer-azure/src/main/resources/application.propertiesThis reverts commit 820860e381079deba98e3885c33f30ff6e629ed9.
Conflicts:
provider/indexer-azure/src/main/resources/application.propertieshttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/241Revert "Merge branch 'istioDnsFix' into 'master'"2021-12-08T15:32:28ZAnkur RawatRevert "Merge branch 'istioDnsFix' into 'master'"This reverts merge request !240This reverts merge request !240Ankur RawatAnkur Rawathttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/374Revert "Merge branch 'indexing_virtual_properties' into 'master'"2022-09-01T12:27:12ZMarc Burnie [AWS]Revert "Merge branch 'indexing_virtual_properties' into 'master'"This reverts merge request !357This reverts merge request !357https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/606Revert "Merge branch 'augmenter_performance_enhancement' into 'master'"2023-08-25T13:51:52ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comRevert "Merge branch 'augmenter_performance_enhancement' into 'master'"This reverts merge request !601This reverts merge request !601Rustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/165Resolve "Upgrade Core Common Dependency"2022-02-08T12:52:02ZDavid Diederichd.diederich@opengroup.orgResolve "Upgrade Core Common Dependency"Closes #21
See osdu/platform&9 for more details.
## MR's Raison d'ĂȘtre
This MR updates the core common dependency to use the latest released version of the library. Keeping our library usage at the latest helps avoid subtle incompati...Closes #21
See osdu/platform&9 for more details.
## MR's Raison d'ĂȘtre
This MR updates the core common dependency to use the latest released version of the library. Keeping our library usage at the latest helps avoid subtle incompatibility bugs from creeping in, and ensures that all Data Platform code is staying current with bug fixes and performance improvements in the core libraries.
*Dependency Table, after the application of this MR's changes*
| Maven Dependencies | _Root POM_ | testing/ |
| ------------------------ | ------------------ | ---------- |
| os-core-common | 0.12.0-rc3 | 0.12.0-rc3 |
| core.aws.os-core-lib-aws | 0.11.0 | 0.3.16 |
| core-lib-azure | 0.11.0-rc5 | 0.11.0-rc4 |
| core-lib-gcp | 0.10.0, 0.12.0-rc3 | |
| os-core-lib-ibm | 0.12.0-SNAPSHOT | 0.7.0 |
## Housekeeping Updates
### FOSSA Update
This MR also updates the FOSSA attributions, since these need to be kept up to date on every MR. Changes are expected whenever the library dependencies are updated.
### Update Deprecated Pipeline Includes
This MR also updates the `.gitlab-ci.yml` file to use the newer pipeline includes, rather than relying on deprecated includes that mimic old behavior. These housekeeping updates should be done regularly on MRs when they are discovered so the old CI include files can be deleted and no longer supported.M9 - Release 0.12David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/265Remove Page Size check while querying Storage API2022-07-12T15:41:14ZVibhuti Sharma [Microsoft]Remove Page Size check while querying Storage APIVibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/98Removed elastic 6.6.2 from int tests ibm2021-03-01T12:49:27ZRiabokon Stanislav(EPAM)[GCP]Removed elastic 6.6.2 from int tests ibmRemoved elastic 6.6.2 from int tests ibm
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?...Removed elastic 6.6.2 from int tests ibm
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [X] IBM
## Does this introduce a breaking change?
- [NO]
## Have you added/updated Unit Tests and Integration Tests?
- [NO]Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/336reindex status code fix2023-02-04T05:35:46ZSHEFFALI JAINreindex status code fixCurrently re-index API sends out 200 response code no matter reindexing activity is performed or not.
Now, sending out 500 status code if any of the kind is not reindexed.
If successful in pitting messages in servcie bus then 200.
Also r...Currently re-index API sends out 200 response code no matter reindexing activity is performed or not.
Now, sending out 500 status code if any of the kind is not reindexed.
If successful in pitting messages in servcie bus then 200.
Also reindex by kind will show the same behaviour.
Advancement : Saving all the response for each kind in hashmap. That can be used to send as response to client for better tracking of what kind is not reindexed.SHEFFALI JAINSabarish K R ESHEFFALI JAINhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/262Reindex API Improvement2022-01-21T10:22:44ZVibhuti Sharma [Microsoft]Reindex API ImprovementAddresses https://community.opengroup.org/osdu/platform/system/storage/-/issues/106Addresses https://community.opengroup.org/osdu/platform/system/storage/-/issues/106Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/615Refactoring send method2023-10-30T04:17:33ZHarshika DhootRefactoring send methodAdding logs such that for any 4xx or 5xx calls we are able to trace the flow using correlation id, urls, http methods, which will enable us to perform the debugging faster and also at the places where we are blocked because of no correla...Adding logs such that for any 4xx or 5xx calls we are able to trace the flow using correlation id, urls, http methods, which will enable us to perform the debugging faster and also at the places where we are blocked because of no correlation id
ADME instance compatibility:![indexeradme](/uploads/cfc50131a39cc3e6c93a1198eb5330d8/indexeradme.png)
Test case scenarios
1. green case: ![indexgreen](/uploads/6e8e751b027239ab784f97559cb494e9/indexgreen.png)
2. 4xx case: ![indexe4xx](/uploads/63ab582f32eadb8a4384469aeaeb1ee0/indexe4xx.png)
3. 5xx case: ![indexe5xx](/uploads/6143b936a915eee3397aeb16bcba33c0/indexe5xx.png)Harshika DhootHarshika Dhoothttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/406post_geoshape_decimation2022-10-20T15:23:22ZZhibin Maipost_geoshape_decimationZhibin MaiZhibin Maihttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/16Port the latest clean-up cron changes2020-09-15T07:14:53ZSviatoslav NekhaienkoPort the latest clean-up cron changes* What is the change? This change is to port the latest clean-up cron changes from GA
* What does it impact? Adds a new endpoint to run a clean-up job for all providers.
* How do I reproduce or test the change? You can trigger GET reque...* What is the change? This change is to port the latest clean-up cron changes from GA
* What does it impact? Adds a new endpoint to run a clean-up job for all providers.
* How do I reproduce or test the change? You can trigger GET request via /_dps/task-handlers/index-cleanup, unit tests were added as well
* Other
Following properties(env variables) must be set
CRON_INDEX_CLEANUP_PATTERN
CRON_INDEX_CLEANUP_TENANTS
GAE_SERVICENeelesh ThakurSviatoslav NekhaienkoNeelesh Thakurhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/298PBI-5653: Upgrading spring boot dependencies. Spring boot dependencies wil be...2022-03-28T11:03:12ZHarsheet ShahPBI-5653: Upgrading spring boot dependencies. Spring boot dependencies wil be...PBI-5653: Upgrading spring boot dependencies. Spring boot dependencies wil be fetched from os-common-core.PBI-5653: Upgrading spring boot dependencies. Spring boot dependencies wil be fetched from os-common-core.Harsheet ShahHarsheet Shahhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/100Og-ibm-sync-2502212021-03-02T08:13:36ZMallikarjuna MallichettuOg-ibm-sync-250221Elastic Search 7Elastic Search 7Shrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/96Og ibm sync 2502212021-03-02T05:43:31ZMallikarjuna MallichettuOg ibm sync 250221Elastic search 7 and Fix on Unit test failsElastic search 7 and Fix on Unit test failsShrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/378No more retry attempts for schema not found2022-09-13T05:00:06ZHarshika DhootNo more retry attempts for schema not foundRetry in schema service for schema not found is being removed.
Call to storage service for schema is removed along with the test case for storage serviceRetry in schema service for schema not found is being removed.
Call to storage service for schema is removed along with the test case for storage serviceHarshika DhootHarshika Dhoothttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/598Merged from M162023-08-16T21:44:13ZVaibhavi KamaniMerged from M16Merged from M16Merged from M16Vaibhavi KamaniVaibhavi Kamani