Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2022-04-19T14:59:57Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/401gcp-untie-messaging-from-http(GONRG-4640)2022-04-19T14:59:57ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comgcp-untie-messaging-from-http(GONRG-4640)## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IB...## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES]
## What is the current behavior?
Storage after migration to OQM service is not able to process `legal_changed` events due to request scope boundaries in common code, because OQM is designed to use only pull subscribers.
## What is the new/expected behavior?
Storage service context was split into two separate contexts, one for serving HTTP requests via API that is still bound to request scope,
and one for message event processing which contains overridden bean definitions, not limited with request scope.
## Have you added/updated Unit Tests and Integration Tests?
YesM12 - Release 0.15Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/105Gcp update os core common / fix pubsub publisher (GONRG-1211/GONRG-1299)2023-08-18T22:27:02ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comGcp update os core common / fix pubsub publisher (GONRG-1211/GONRG-1299)# Description:
Two changes:
1. Update core-common with url normalization fix;
2. Fix pubsub publisher, creating new publisher instance for each publish request
leading to
`
java.lang.RuntimeException: ManagedChannel allocation site
io...# Description:
Two changes:
1. Update core-common with url normalization fix;
2. Fix pubsub publisher, creating new publisher instance for each publish request
leading to
`
java.lang.RuntimeException: ManagedChannel allocation site
io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue: *~*~*~ Channel ManagedChannelImpl{logId=4613, target=pubsub.googleapis.com:443} was not shutdown properly!!!
`
# How to test:
1. Url normalization fix:
Service was configured with malformed entitlements url, and keep working properly.
2. Publisher fix:
Error
RuntimeException: ManagedChannel allocation site
Count
10,920
Last seen
3 days ago
Service keep working properly , and not throwing Runtime exception related to
misbehaving with connection.
# Changes include:
- [x] Refactor (a non-breaking change that improves code maintainability).
- [x] Bugfix (a non-breaking change that solves an issue).
- [ ] New feature (a non-breaking change that adds functionality).
- [ ] Breaking change (a change that is not backward-compatible and/or changes current functionality).
# Changes in:
- [x] GCP
- [x] Azure
- [x] AWS
- [x] IBM
# Dev Checklist:
- [ ] Added Unit Tests, wherever applicable.
- [ ] Updated the Readme, if applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.
# Other comments:
depends on https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/38M1 - Release 0.1Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/857GC Spring 6 migration, rearrange comm impl dependencies, upd core gc2024-03-14T12:44:25ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comGC Spring 6 migration, rearrange comm impl dependencies, upd core gc# Merge request template# Merge request templateRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/603GC use full image name2023-08-18T22:20:39ZAliaksandr Ramanovich (EPAM)GC use full image nameUse full name for docker imagesUse full name for docker imagesM16 - Release 0.19Aliaksandr Ramanovich (EPAM)Aliaksandr Ramanovich (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/11Generate required test data in the integration tests2023-08-18T22:29:56ZWyatt NielsenGenerate required test data in the integration testsUpdated integration test setup to generate data for tests instead of depending on data already in environment. Update cloudStorageImpl and RecordsMetadataRepositoryImpl to handle user verification in the same way as other osdu implementa...Updated integration test setup to generate data for tests instead of depending on data already in environment. Update cloudStorageImpl and RecordsMetadataRepositoryImpl to handle user verification in the same way as other osdu implementationsM1 - Release 0.1Brandt BealBrandt Bealhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/10Generate required test data in the integration tests2020-05-20T17:37:34ZWyatt NielsenGenerate required test data in the integration testsUpdated integration test setup to generate data for tests instead of depending on data already in environment. Update cloudStorageImpl and
RecordsMetadataRepositoryImpl to handle user verification in the same way as other osdu implement...Updated integration test setup to generate data for tests instead of depending on data already in environment. Update cloudStorageImpl and
RecordsMetadataRepositoryImpl to handle user verification in the same way as other osdu implementationshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/622Generate Swagger using springdoc-openapi2023-03-21T11:34:32ZThulasi Dass SubramanianGenerate Swagger using springdoc-openapi## Type of change
- [ ] Bug Fix
- [x] Feature
**Link to ADR(Architecture Decision Record)** : [Swagger using springdoc-openapi](https://community.opengroup.org/osdu/platform/system/home/-/issues/97)
## OpenAPI 3.0 related changes
- u...## Type of change
- [ ] Bug Fix
- [x] Feature
**Link to ADR(Architecture Decision Record)** : [Swagger using springdoc-openapi](https://community.opengroup.org/osdu/platform/system/home/-/issues/97)
## OpenAPI 3.0 related changes
- upgraded to latest **springdoc openapi** latest version [1.6.14](https://mvnrepository.com/artifact/org.springdoc/springdoc-openapi-ui/1.6.14)
- used [**@OpenAPIDefinition**](https://docs.swagger.io/swagger-core/v2.0.9/apidocs/io/swagger/v3/oas/annotations/OpenAPIDefinition.html) annotation to populate OpenAPI Object fields _[info, tags, servers, security]_
- Documented **Query, Record, Patch , Info & Health** API with OpenAPI 3.0 **Annotations**
- Added the standard HTTP Response(4xx, 5x****x) for API Responses
- Custom Path for
- **Swagger UI**: https://host/context-path/swagger (will redirect to https://host/context-path/swagger-ui/index.html)
- **api-docs (JSON)** : https://host/context-path/api-docs
- **api-docs (YAML)** : https://host/context-path/api-docs.yaml
## Other Changes
- **Configurable** descriptions managed in [swagger.properties](https://community.opengroup.org/osdu/platform/system/storage/-/blob/az/td-swagger-springdoc-openapi/storage-core/src/main/resources/swagger.properties)
- added **Integration Test** cases for _**Swagger-UI, api-docs**_ endpoints
- Hide **deprecated** [**Schema, PubSubEndpoints**] related API operations in documentation
- Deleted HomeController
## References
- https://springdoc.org/faq.html#_can_i_use_spring_property_with_swagger_annotations
- https://springdoc.org/migrating-from-springfox.htmlM16 - Release 0.19Thulasi Dass SubramanianThulasi Dass Subramanianhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/229(GNORG-2702) Update .gitlab-ci.yml2023-08-18T22:23:24ZVladislav Shishko (EPAM)(GNORG-2702) Update .gitlab-ci.yml# Merge request template# Merge request templateM7 - Release 0.10Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/683GONGR-6885 Reduce requests according to VPA2023-09-08T19:26:44ZAndriy Halka [EPAM / GCP]GONGR-6885 Reduce requests according to VPAM18 - Release 0.21https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/713GONGR-7357: Refactor names in pipelines2023-06-27T10:55:33ZAndriy Halka [EPAM / GCP]GONGR-7357: Refactor names in pipelines# Merge request template# Merge request templateM19 - Release 0.22https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/151(GONRG-1838) GCP cannot retrieve a record with space2023-08-18T22:24:44ZIgor Filippov (EPAM)(GONRG-1838) GCP cannot retrieve a record with space## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IB...## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## Have you added/updated Unit Tests and Integration Tests?
- [NO]M5 - Release 0.8Igor Filippov (EPAM)Rostislav Dublin (EPAM)Igor Filippov (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/174(GONRG-2081) Update .gitlab-ci.yml2023-08-18T22:24:27ZVladislav Shishko (EPAM)(GONRG-2081) Update .gitlab-ci.yml# Merge request template# Merge request templateM5 - Release 0.8Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/197(GONRG-2388) Update .gitlab-ci.yml2023-08-18T22:23:57ZVladislav Shishko (EPAM)(GONRG-2388) Update .gitlab-ci.yml# Merge request template# Merge request templateM6 - Release 0.9Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/209GONRG-2478 Added helm charts2023-08-18T22:23:40ZOleksii Tsyganov (EPAM)GONRG-2478 Added helm charts# Merge request template# Merge request templateM7 - Release 0.10Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/220GONRG-2577: heln chart added partition variable and changed resource api temp...2023-08-18T22:23:29ZAliaksandr Lubouski (EPAM)GONRG-2577: heln chart added partition variable and changed resource api templationghelm chart added partition variable and changed resource api templatinghelm chart added partition variable and changed resource api templatingM7 - Release 0.10https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/291(GONRG-3326) update hosts2023-08-18T22:22:33ZVladislav Shishko (EPAM)(GONRG-3326) update hosts# Merge request template# Merge request templateM10 - Release 0.13Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/275GONRG-3398 - set default number of replicas for storage2023-08-18T22:22:43ZOleksandr Kosse (EPAM)GONRG-3398 - set default number of replicas for storageScale storage serviceScale storage serviceM9 - Release 0.12Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/319GONRG-4016: Fix log4j2022-09-16T08:05:01ZArtem Dobrynin (EPAM)GONRG-4016: Fix log4jUpdated version to 2.17.0 to fix vulnerabilities
https://community.opengroup.org/groups/osdu/platform/-/epics/11
Part of the #103 seriesUpdated version to 2.17.0 to fix vulnerabilities
https://community.opengroup.org/groups/osdu/platform/-/epics/11
Part of the #103 seriesM10 - Release 0.13Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/338GONRG-4118 Add imagePullPolicy value2023-08-18T22:22:07ZIgor Zimovets (EPAM)GONRG-4118 Add imagePullPolicy value# Merge request template# Merge request templateM10 - Release 0.13https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/350GONRG-4211: Changed crs-converter to crs-conversion2023-08-18T22:22:01ZSiarhei Symanovich (EPAM)GONRG-4211: Changed crs-converter to crs-conversionChanged service name crs-converter to crs-conversionChanged service name crs-converter to crs-conversionM10 - Release 0.13Siarhei Symanovich (EPAM)Siarhei Symanovich (EPAM)