Indexer merge requestshttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests2022-11-04T12:10:26Zhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/414Debug geoshape decimation2022-11-04T12:10:26ZZhibin MaiDebug geoshape decimationDebug geoshape decimationDebug geoshape decimationZhibin MaiZhibin Maihttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/409DO NOT MERGE2022-10-13T12:48:52Zshivani karipeDO NOT MERGEhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/406post_geoshape_decimation2022-10-20T15:23:22ZZhibin Maipost_geoshape_decimationZhibin MaiZhibin Maihttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/397Draft: Revert_"Merge-branch-'harshika-sch-del-latency'-into-'master'"2022-12-05T04:35:13ZHarshika DhootDraft: Revert_"Merge-branch-'harshika-sch-del-latency'-into-'master'"This reverts merge request !384This reverts merge request !384Harshika DhootHarshika Dhoothttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/395Upgrade First Party Library Dependencies for Release 0.172022-10-12T03:58:01ZDavid Diederichd.diederich@opengroup.orgUpgrade First Party Library Dependencies for Release 0.17This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any...This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any library that is older than the previous release will be left as-is, since the upgrade is likely to be more complicated.
Furthermore, the upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: f2f69c95284967bdac75d65c0ded9e8d284ee42c
Maven: 0.17.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------- | ---------------------- |
| core-lib-azure | 0.15.2 | 0.12.0-rc10 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.14.0-rc2 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.16.1 | 0.14.0-rc8 |
| os-core-lib-ibm | 0.16.0-rc1 | 0.13.0 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.2.2 | 2.13.2.2, 2.13.2 |
| (3rd Party) net.minidev.json-smart | 2.4.7 | 2.4.6 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.11.2, 2.13.0 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2, 2.13.0 |
| (3rd Party) org.springframework.spring-webflux | 5.3.12 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.22 | 5.1.19.RELEASE |
```
Warning: Found Vulnerable Spring WebFlux dependency (<5.2.20 || >=5.3.0 <5.3.18)
└─ _Root_
└─ org.opengroup.osdu.indexer.indexer-azure == 0.17.0-SNAPSHOT
└─ com.azure.spring.azure-spring-boot-starter-active-directory == 3.4.0
└─ org.springframework.boot.spring-boot-starter-webflux == 2.4.12
└─ org.springframework.spring-webflux == 5.3.12
```
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade
SHA: 1fa002811b2e660cbbc495be1e2eb7a5abf9095b
Maven: 0.17.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------- | ---------------------- |
| core-lib-azure | 0.15.2 | 0.12.0-rc10 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.14.0-rc2 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.17.0 | 0.14.0-rc8 |
| os-core-lib-ibm | 0.16.0-rc1 | 0.13.0 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.2.2 | 2.13.2.2, 2.13.2 |
| (3rd Party) net.minidev.json-smart | 2.4.7 | 2.4.6 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.11.2, 2.13.0 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2, 2.13.0 |
| (3rd Party) org.springframework.spring-webflux | 5.3.12 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.22 | 5.1.19.RELEASE |
```
Warning: Found Vulnerable Spring WebFlux dependency (<5.2.20 || >=5.3.0 <5.3.18)
└─ _Root_
└─ org.opengroup.osdu.indexer.indexer-azure == 0.17.0-SNAPSHOT
└─ com.azure.spring.azure-spring-boot-starter-active-directory == 3.4.0
└─ org.springframework.boot.spring-boot-starter-webflux == 2.4.12
└─ org.springframework.spring-webflux == 5.3.12
```M14 - Release 0.17https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/388Update pom.xml2022-09-28T10:18:47ZRiabokon Stanislav(EPAM)[GCP]Update pom.xmlRiabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/380BugFix: 8622 Indexer publishes message to stale service bus topic2022-10-07T11:40:22ZKamalika SahaBugFix: 8622 Indexer publishes message to stale service bus topicIntroducing a flag defaulting to false which will prevent or allow publishing message to "indexing-progress" topic of servicebusIntroducing a flag defaulting to false which will prevent or allow publishing message to "indexing-progress" topic of servicebusKamalika SahaKamalika Sahahttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/378No more retry attempts for schema not found2022-09-13T05:00:06ZHarshika DhootNo more retry attempts for schema not foundRetry in schema service for schema not found is being removed.
Call to storage service for schema is removed along with the test case for storage serviceRetry in schema service for schema not found is being removed.
Call to storage service for schema is removed along with the test case for storage serviceHarshika DhootHarshika Dhoothttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/377Draft: Removing number of retry attempts on schema service when schema not found2022-09-05T10:56:49ZHarshika DhootDraft: Removing number of retry attempts on schema service when schema not foundHarshika DhootHarshika Dhoothttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/376Draft:No more retry attempts for schema not found2022-09-13T08:48:06ZHarshika DhootDraft:No more retry attempts for schema not foundRemoved the number of retry attempts made on schema service when schema is not found.
Also removed the storage service calls.Removed the number of retry attempts made on schema service when schema is not found.
Also removed the storage service calls.https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/375Draft: No retry on schema not found2022-09-02T09:13:34ZHarshika DhootDraft: No retry on schema not foundNumber of retry attempts of calling schema service is reduced to 0 if schema is not found(404).
Calling of storage service after schema service is also removed.Number of retry attempts of calling schema service is reduced to 0 if schema is not found(404).
Calling of storage service after schema service is also removed.https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/374Revert "Merge branch 'indexing_virtual_properties' into 'master'"2022-09-01T12:27:12ZMarc Burnie [AWS]Revert "Merge branch 'indexing_virtual_properties' into 'master'"This reverts merge request !357This reverts merge request !357https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/359Upgrade First Party Library Dependencies for Release 0.162022-08-16T17:37:44ZDavid Diederichd.diederich@opengroup.orgUpgrade First Party Library Dependencies for Release 0.16This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any...This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any library that is older than the previous release will be left as-is, since the upgrade is likely to be more complicated.
Furthermore, the upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: f477639c4fb3e5a8175f9d938b6e1fab1772f649
Maven: 0.17.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------------- | ---------------------- |
| core-lib-azure | 0.15.2 | 0.12.0-rc10 |
| core-lib-gcp | 0.15.0 | |
| os-core-lib-aws | 0.14.0-rc2 | 0.14.0-rc2 |
| obm | 0.15.0 | |
| oqm | 0.15.0 | |
| os-core-common | 0.14.0-rc8 | 0.14.0-rc8 |
| os-core-lib-ibm | 0.16.0-rc1 | 0.13.0 |
| osm | 0.15.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.11.4, 2.13.2.2 | 2.13.2.2, 2.13.2 |
| (3rd Party) net.minidev.json-smart | 2.4.7 | 2.4.6, 2.4.7 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.11.2, 2.13.0 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2, 2.13.0 |
| (3rd Party) org.springframework.spring-webflux | 5.3.12 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.12 | 5.1.19.RELEASE |
```
Critical: Found Vulnerable Spring MVC dependency (<5.2.20 || >=5.3.0 <5.3.18)
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
Critical: Found Vulnerable Spring WebFlux dependency (<5.2.20 || >=5.3.0 <5.3.18)
```
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade
SHA: 99f0806bba130c7b32c8f2ba2b980d9dc6c833a0
Maven: 0.17.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------------- | ---------------------- |
| core-lib-azure | 0.16.0 | 0.12.0-rc10 |
| core-lib-gcp | 0.16.0 | |
| os-core-lib-aws | 0.14.0-rc2 | 0.14.0-rc2 |
| obm | 0.16.0 | |
| oqm | 0.16.0 | |
| os-core-common | 0.14.0-rc8 | 0.14.0-rc8 |
| os-core-lib-ibm | 0.16.0 | 0.13.0 |
| osm | 0.16.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.11.4, 2.13.2.2 | 2.13.2.2, 2.13.2 |
| (3rd Party) net.minidev.json-smart | 2.4.7 | 2.4.6, 2.4.7 |
| (3rd Party) org.apache.logging.log4j.log4j-api | 2.17.1 | 2.11.1, 2.11.2, 2.13.0 |
| (3rd Party) org.apache.logging.log4j.log4j-core | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-jul | 2.17.1 | 2.13.3 |
| (3rd Party) org.apache.logging.log4j.log4j-to-slf4j | 2.17.1 | 2.11.2, 2.13.0 |
| (3rd Party) org.springframework.spring-webflux | 5.3.12 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.12 | 5.1.19.RELEASE |
```
Critical: Found Vulnerable Spring MVC dependency (<5.2.20 || >=5.3.0 <5.3.18)
Critical: Found Vulnerable Jackson Databind dependency (<2.12.6.1 || >=2.13.0 <2.13.2.1)
Critical: Found Vulnerable Spring WebFlux dependency (<5.2.20 || >=5.3.0 <5.3.18)
```M13 - Release 0.16https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/350Enhanced Logs : Added time taken for important steps so that we can figure ou...2023-02-04T05:35:41ZSabarish K R EEnhanced Logs : Added time taken for important steps so that we can figure out...Enhanced Logs : Added time taken for important steps so that we can figure out where the time is being spent.Enhanced Logs : Added time taken for important steps so that we can figure out where the time is being spent.Sabarish K R ESabarish K R Ehttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/344Fixed jackson conflict version issue2022-07-12T08:07:52ZDmitrii Novikov (EPAM)Fixed jackson conflict version issueDmitrii Novikov (EPAM)Dmitrii Novikov (EPAM)https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/339Draft:Ibm indexer helm2022-07-01T06:09:57ZShrikant GargDraft:Ibm indexer helminitial chart for indexerinitial chart for indexerShrikant GargShrikant Garghttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/336reindex status code fix2023-02-04T05:35:46ZSHEFFALI JAINreindex status code fixCurrently re-index API sends out 200 response code no matter reindexing activity is performed or not.
Now, sending out 500 status code if any of the kind is not reindexed.
If successful in pitting messages in servcie bus then 200.
Also r...Currently re-index API sends out 200 response code no matter reindexing activity is performed or not.
Now, sending out 500 status code if any of the kind is not reindexed.
If successful in pitting messages in servcie bus then 200.
Also reindex by kind will show the same behaviour.
Advancement : Saving all the response for each kind in hashmap. That can be used to send as response to client for better tracking of what kind is not reindexed.SHEFFALI JAINSabarish K R ESHEFFALI JAINhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/335Update core lib azure version2022-06-21T14:02:34ZHarsheet ShahUpdate core lib azure version(cherry picked from commit 1bd4a6e6aaf681ac0b14c12b0c288dd1587258e2)
Conflicts:
.gitlab-ci.yml(cherry picked from commit 1bd4a6e6aaf681ac0b14c12b0c288dd1587258e2)
Conflicts:
.gitlab-ci.ymlHarsheet ShahHarsheet Shahhttps://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/309Enhanced Logs : Added time taken for important steps so that we can figure ou...2023-02-04T05:35:48ZSabarish K R EEnhanced Logs : Added time taken for important steps so that we can figure out...Enhanced Logs : Added time taken for important steps so that we can figure out where the time is being spent.Enhanced Logs : Added time taken for important steps so that we can figure out where the time is being spent.https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/302Upgrade First Party Library Dependencies for Release 0.14 (Except Azure)2022-04-05T10:39:33ZDavid Diederichd.diederich@opengroup.orgUpgrade First Party Library Dependencies for Release 0.14 (Except Azure)This is related to !301, except it holds back the Azure dependency -- based on the result that the Azure tests failed in !201.
### Dependency Information After the UpgradeThis is related to !301, except it holds back the Azure dependency -- based on the result that the Azure tests failed in !201.
### Dependency Information After the UpgradeM11 - Release 0.14David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.org