Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2023-08-18T22:20:57Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/472GONRG-5117-Refactor variables with a camel case2023-08-18T22:20:57ZYevhenii Orlov (EPAM) [GCP]GONRG-5117-Refactor variables with a camel case# Merge request template# Merge request templateM14 - Release 0.17https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/443GONRG-5182-external-postgresql-anthos-df2022-08-05T08:54:32ZSiarhei Symanovich (EPAM)GONRG-5182-external-postgresql-anthos-dfadded partitionIDadded partitionIDSiarhei Symanovich (EPAM)Siarhei Symanovich (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/401gcp-untie-messaging-from-http(GONRG-4640)2022-04-19T14:59:57ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comgcp-untie-messaging-from-http(GONRG-4640)## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IB...## Type of change
- [ ] Bug Fix
- [x] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES]
## What is the current behavior?
Storage after migration to OQM service is not able to process `legal_changed` events due to request scope boundaries in common code, because OQM is designed to use only pull subscribers.
## What is the new/expected behavior?
Storage service context was split into two separate contexts, one for serving HTTP requests via API that is still bound to request scope,
and one for message event processing which contains overridden bean definitions, not limited with request scope.
## Have you added/updated Unit Tests and Integration Tests?
YesM12 - Release 0.15Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/354Enable Hybrid Lib JwtToken service for Storage Service (EPAM GONRG-4269)2022-02-04T18:55:37ZDmitrii Novikov (EPAM)Enable Hybrid Lib JwtToken service for Storage Service (EPAM GONRG-4269)## Type of change
- [ ] Bug Fix
- [x] Feature
https://jiraeu.epam.com/browse/GONRG-4269
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud...## Type of change
- [ ] Bug Fix
- [x] Feature
https://jiraeu.epam.com/browse/GONRG-4269
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES]
## What is the current behavior?
Removed mappers classes
Connected core-lib-gcp token provider and mappersM11 - Release 0.14Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/842minor fix on aws region2024-02-06T16:24:38ZYunhua Koglinminor fix on aws region# Merge request template# Merge request templateM23 - Release 0.26Yunhua KoglinYunhua Koglinhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/818Gonrg 9065 storage bootstrap disable2024-01-17T09:44:08ZAliaksandr Ramanovich (EPAM)Gonrg 9065 storage bootstrap disable
GC changes only
Disable storage bootstrap due to duplicating this process in Data bootstrap repo
GC changes only
Disable storage bootstrap due to duplicating this process in Data bootstrap repoM23 - Release 0.26Aliaksandr Ramanovich (EPAM)Aliaksandr Ramanovich (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/756GONRG-7648: add variable2023-09-01T11:38:21ZYauheni Rykhter (EPAM)GONRG-7648: add variableM20 - Release 0.23Yauheni Rykhter (EPAM)Yauheni Rykhter (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/740Migration to JDK 17 (GONRG-7527)2024-01-25T13:47:33ZRiabokon Stanislav(EPAM)[GCP]Migration to JDK 17 (GONRG-7527)## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] I...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] IBM
## Does this introduce a breaking change?
- [YES]
* Migration to Java 17.
* Unit test fixes with build run args and dependency upgrades.
* Refactored with Apache's `CloseableHttpClient` supporting all HTTP methods (including PATCH).M20 - Release 0.23Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/667[GONRG-6868] Enable policy in integration tests2023-09-08T19:26:42ZDanylo Vanin (EPAM)[GONRG-6868] Enable policy in integration tests# Merge request template# Merge request templateM18 - Release 0.21Danylo Vanin (EPAM)Danylo Vanin (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/633GONRG-6646: Add variable for disabling OPA2023-03-07T09:32:34ZVolodymyr Pienskoi [EPAM / GCP]GONRG-6646: Add variable for disabling OPAAdded `opaEnabled` value to Helm chart that disables OPA by default.Added `opaEnabled` value to Helm chart that disables OPA by default.M16 - Release 0.19Volodymyr Pienskoi [EPAM / GCP]Volodymyr Pienskoi [EPAM / GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/580Connection to Redis must be protected by password2022-12-19T12:31:27ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comConnection to Redis must be protected by password## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [ ] Bug Fix
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Redis connection service doesn't allow to use passwords in the GCP module.
## What is the new/expected behavior?
It is possible to configure redies clients with passwords.M16 - Release 0.19Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/574GONRG-5937: Merge GC Helms to the common one2023-01-12T23:53:23ZVolodymyr Pienskoi [EPAM / GCP]GONRG-5937: Merge GC Helms to the common oneM16 - Release 0.19Volodymyr Pienskoi [EPAM / GCP]Volodymyr Pienskoi [EPAM / GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/540added ability to config redis password and ssl (GONRG-5301)2022-12-13T00:28:53ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comadded ability to config redis password and ssl (GONRG-5301)added ability to config redis password and ssladded ability to config redis password and sslM15 - Release 0.18Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/513fix CrsConversionService potential class cast issues2022-10-02T04:42:54ZYauheni Lesnikaufix CrsConversionService potential class cast issuesIssue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/144Issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/144M14 - Release 0.17Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/477[GONRG-5460] Added bootstrap script2023-08-18T22:20:55ZDanylo Vanin (EPAM)[GONRG-5460] Added bootstrap script# Merge request template# Merge request templateM14 - Release 0.17Danylo Vanin (EPAM)Danylo Vanin (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/407[GONRG-4833] Refactor pipeline2023-08-18T22:21:28ZDanylo Vanin (EPAM)[GONRG-4833] Refactor pipeline# Merge request template# Merge request templateM12 - Release 0.15Danylo Vanin (EPAM)Danylo Vanin (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/404update Storage API spec2023-08-18T22:21:33ZAn Ngoupdate Storage API spec## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/storage/-/issues/37
## Does this introduce a change in t...## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/storage/-/issues/37
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
The [Storage API spec](https://community.opengroup.org/osdu/platform/system/storage/-/blob/master/docs/api/storage_openapi.yaml) does not match the implementation capabilities. Here the two issues:
* batch record read with normalization (as used by the indexer).
* patch capability for acl, legal and the likes, which does not bump the version.
Structural error at info.contact.email
should match format "email"
format: email
Jump to line 9
Structural error at paths./records/delete.post
should NOT have additional properties
additionalProperty: requestBody
Jump to line 200
Structural error at paths./records/delete.post.parameters.0
should NOT have additional properties
additionalProperty: schema
Jump to line 208
Structural error at paths./records/delete.post.parameters.0
should have required property 'type'
missingProperty: type
Jump to line 208
Structural error at paths./records/delete.post.responses.207
should NOT have additional properties
additionalProperty: content
Jump to line 225
Semantic error at paths./records/delete.post.responses.207.content.application/json.schema.items.$ref
$refs must reference a valid location in the document
Jump to line 232
Semantic error at paths./records/delete.post.security.0
Security requirements must match a security definition
Jump to line 238
Semantic error at paths./records/delete.post.security.1
Security requirements must match a security definition
Jump to line 239
Structural error at definitions.MultiRecordIds.properties.attributes
should NOT have additional properties
additionalProperty: allowEmptyValue
Jump to line 728
Structural error at definitions.Record.properties.history
should NOT have additional properties
additionalProperty: allowEmptyValue
Jump to line 849
Structural error at definitions.RecordHistory.properties.parents
should NOT have additional properties
additionalProperty: allowEmptyValue
Jump to line 875
Structural error at definitions.RecordBulkUpdateParam.properties.query
should NOT have additional properties
additionalProperty: allowEmptyValue
Jump to line 957
Structural error at definitions.RecordBulkUpdateParam.properties.ops
should NOT have additional properties
additionalProperty: allowEmptyValue
Jump to line 961
Semantic error at definitions.RecordQuery.properties.ids
Schemas with 'type: array', require a sibling 'items: ' field
Jump to line 996
## What is the new/expected behavior?
Update Storage API spec to include Batch record read with normalization; fixed swagger structural and semantic errors.
## Have you added/updated Unit Tests and Integration Tests?
N/A
## Any other useful information
N/AM12 - Release 0.15https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/391Update helms for anthos on-prem usage [GONRG-4557]2023-08-18T22:21:38ZMikhail Piatliou (EPAM)Update helms for anthos on-prem usage [GONRG-4557]# Merge request template# Merge request templateM12 - Release 0.15Mikhail Piatliou (EPAM)Mikhail Piatliou (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/358Opa integration with feature flag off2023-08-18T22:21:56ZKelly ZhouOpa integration with feature flag offData authorization can be done against OPA policies in Create/Update Record API, here is the wiki link to our POC: https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/wikis/home
In this MR, we integrate OPA wi...Data authorization can be done against OPA policies in Create/Update Record API, here is the wiki link to our POC: https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/wikis/home
In this MR, we integrate OPA with Storage service Create/Update API, but hide the feature behind feature flag until bundle server and opa is setup from different CSPs.M11 - Release 0.14https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/297Catch and throw datastore app exception with non-500 error code2023-08-18T22:22:32ZAlok JoshiCatch and throw datastore app exception with non-500 error code# Merge request template
Refer to this issue https://community.opengroup.org/osdu/platform/system/storage/-/issues/97# Merge request template
Refer to this issue https://community.opengroup.org/osdu/platform/system/storage/-/issues/97M10 - Release 0.13Alok JoshiAlok Joshi