Indexer Queue merge requestshttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests2021-11-08T09:15:09Zhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/100[DO NOT MERGE] Fixing IT2021-11-08T09:15:09ZVibhuti Sharma [Microsoft][DO NOT MERGE] Fixing IT**Problem Statement**
Integration tests are not running in the gitlab and ADO pipeline. This MR contains changes to fix that.
**Testing**
Verified in ADO that the test is running successfully.
![image](/uploads/70f439c8051e3cc7564f3e9...**Problem Statement**
Integration tests are not running in the gitlab and ADO pipeline. This MR contains changes to fix that.
**Testing**
Verified in ADO that the test is running successfully.
![image](/uploads/70f439c8051e3cc7564f3e9dedcae11f/image.png)
Verified in gitlab pipeline that the test is running successfully.
![image](/uploads/fabf12226b6d563d9ba928224457dfc0/image.png)
**Changes needed in ADO pipeline variable group**
In ADO pipelines, the variable group needs to be updated. Updates needed are mentioned here - https://community.opengroup.org/osdu/platform/deployment-and-operations/infra-azure-provisioning/-/merge_requests/479Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/128It fix m8 master2021-11-11T13:18:17ZSmitha ManjunathIt fix m8 masterSmitha ManjunathSmitha Manjunathhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/130Update IT to accept command line input2021-11-12T10:27:41ZSmitha ManjunathUpdate IT to accept command line inputUpdateUpdateSmitha ManjunathSmitha Manjunathhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/121Use core lib aws version 0.12.0-SNAPSHOT2022-01-24T15:13:12ZBill WangUse core lib aws version 0.12.0-SNAPSHOTcommit 1965e4bb
Author: Chau-Nhi Phan <chau-nhi.phan@parivedasolutions.com>
Date: Mon Sep 27 2021 14:58:20 GMT-0700 (PDT)
Use core lib aws version 0.12.0-SNAPSHOTcommit 1965e4bb
Author: Chau-Nhi Phan <chau-nhi.phan@parivedasolutions.com>
Date: Mon Sep 27 2021 14:58:20 GMT-0700 (PDT)
Use core lib aws version 0.12.0-SNAPSHOTBill WangBill Wanghttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/155Aws integration m102022-02-03T15:07:38ZKarina CadetteAws integration m10Karina CadetteKarina Cadettehttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/166Removed unused indexer-queue-gcp.2022-02-21T11:53:38ZRiabokon Stanislav(EPAM)[GCP]Removed unused indexer-queue-gcp.M11 - Release 0.14Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/181Merge branch 'fix-dataformat-vulnerability' into 'master'2022-03-24T07:54:43ZShrikant GargMerge branch 'fix-dataformat-vulnerability' into 'master'fix for dataformat-cbor vulnerabilty
See merge request osdu/platform/system/indexer-queue!180
(cherry picked from commit 63d20313911291f9c108d578e798007d48238b66)
9b6ad9f4 fix for dataformat-cbor vulnerabiltyfix for dataformat-cbor vulnerabilty
See merge request osdu/platform/system/indexer-queue!180
(cherry picked from commit 63d20313911291f9c108d578e798007d48238b66)
9b6ad9f4 fix for dataformat-cbor vulnerabiltyM11 - Release 0.14Anuj GuptaShrikant GargAnuj Guptahttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/167Fixed security issues related to jackson-databind2022-03-29T12:50:05ZRiabokon Stanislav(EPAM)[GCP]Fixed security issues related to jackson-databindFixed security issues related to jackson-databind
Updated to 2.9.10Fixed security issues related to jackson-databind
Updated to 2.9.10Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/192Draft: Merge M8 master to OSDU master2022-04-07T05:38:44ZAkshay P SDraft: Merge M8 master to OSDU masterThis MR is to merge M8 master to OSDU Master thereby moving the fixes made in m8 master alone back to the master branch.This MR is to merge M8 master to OSDU Master thereby moving the fixes made in m8 master alone back to the master branch.Akshay P SAkshay P Shttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/191PBI-6584: Upgrading spring boot dependencies. Spring boot dependencies will b...2022-04-11T04:39:00ZHarsheet ShahPBI-6584: Upgrading spring boot dependencies. Spring boot dependencies will be...PBI-6584: Upgrading spring boot dependencies. Spring boot dependencies will be fetched from os-common-core.PBI-6584: Upgrading spring boot dependencies. Spring boot dependencies will be fetched from os-common-core.Harsheet ShahHarsheet Shahhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/105not to be merged2022-04-18T13:56:28ZNikhil Singh[MicroSoft]not to be mergedhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/200Enable azure health2022-05-02T16:12:33ZHarsheet ShahEnable azure healthEnable Azure health endpointEnable Azure health endpointHarsheet ShahHarsheet Shahhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/199Enable azure health2022-05-10T07:02:40ZHarsheet ShahEnable azure healthEnabling azure health endpointEnabling azure health endpointHarsheet ShahHarsheet Shahhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/211fix auth header for istio2022-05-24T12:37:08ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comfix auth header for istiohttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/203Fix Azure Test Failure2022-07-17T16:04:25ZVibhuti Sharma [Microsoft]Fix Azure Test FailureIndexer-Azure was failing with runtime error with stack trace shown below -
```
Caused by: java.lang.ClassNotFoundException: com.fasterxml.jackson.core.util.JacksonFeature
at java.net.URLClassLoader.findClass(URLClassLoader.java:...Indexer-Azure was failing with runtime error with stack trace shown below -
```
Caused by: java.lang.ClassNotFoundException: com.fasterxml.jackson.core.util.JacksonFeature
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
at org.springframework.boot.loader.LaunchedURLClassLoader.loadClass(LaunchedURLClassLoader.java:151)
at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
... 84 more
```
The aim of this MR is to fix this error.Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/233MSCOSDU-127 update deployment2022-07-26T12:57:43ZIgor Zimovets (EPAM)MSCOSDU-127 update deploymentChange motivation:
https://github.com/Azure/application-gateway-kubernetes-ingress/blob/master/docs/how-tos/minimize-downtime-during-deployments.mdChange motivation:
https://github.com/Azure/application-gateway-kubernetes-ingress/blob/master/docs/how-tos/minimize-downtime-during-deployments.mdhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/163configuring rate limit filter2022-08-05T06:23:59ZSHEFFALI JAINconfiguring rate limit filter## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [ ] YES
- [x] NO
## Does this introduce a change in the...## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [ ] YES
- [x] NO
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [ ] YES
- [x] NO
## Scope and Context
We are trying to provide design via which rate limiting can be applied to any service if enabled via flag and will be disabled by default. By setting a limit on how many requests a consumer is allowed to make in a given unit of time. We reject any requests above the limit with an appropriate response, like HTTP status 429 (Too Many Requests).
## What is the current behavior?
Currently, no rate limiting is applied on service which can limit the count of users accessing it.
## What is the new/expected behavior?
The service will have specific token count which will set limit to restrict number of users using the service per cycle.
## Have you added/updated Unit Tests and Integration Tests?
No.
## Any other useful information
Added Envoy filter to apply rate limiting. Added support to generate yaml file via Helm in deployment itself.
Initially value of applying rate limit filter is set to false.
It can be set while installing helm command using following instruction :
--set envoyFilter.enabled=trueSHEFFALI JAINSHEFFALI JAINhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/171upgrading jackson-databind2022-09-25T13:19:50ZAkanksha Prasadupgrading jackson-databindUpgraded jackson-databind versionUpgraded jackson-databind versionAkanksha PrasadAkanksha Prasadhttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/246Mark IndexProcessorTest as TODO2022-09-26T18:56:31ZXiangliang MengMark IndexProcessorTest as TODOOkoun-Ola Fabien HouetoXiangliang MengOkoun-Ola Fabien Houetohttps://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/247Mark IndexProcessorTest as TODO2022-09-28T13:23:34ZXiangliang MengMark IndexProcessorTest as TODOOkoun-Ola Fabien HouetoXiangliang MengOkoun-Ola Fabien Houeto