Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2022-09-16T02:20:00Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/463Upgrade spring-webmvc.2022-09-16T02:20:00ZMorris EstepaUpgrade spring-webmvc.# Merge request template# Merge request templateM13 - Release 0.16Morris EstepaMorris Estepahttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/462add extra validation for null acl on azure RecordMetadataRepository createOrU...2022-09-22T15:02:43ZYauheni Lesnikauadd extra validation for null acl on azure RecordMetadataRepository createOrUpdateWe are observing corrupted records with null acl on some environments. This changes should eliminate possibility of the issueWe are observing corrupted records with null acl on some environments. This changes should eliminate possibility of the issueM13 - Release 0.16Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/459Removed gcp reference module.2022-08-09T00:31:40ZRiabokon Stanislav(EPAM)[GCP]Removed gcp reference module.Removed GCP reference module.Removed GCP reference module.M13 - Release 0.16Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/458Add deletion of a record after integration test2022-09-16T08:28:15ZYifei XuAdd deletion of a record after integration test## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud prov...## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
A record is not deleted after the integration test. It should be.
## What is the new/expected behavior?
All records should be deleted.
## Have you added/updated Unit Tests and Integration Tests?
Yes
## Any other useful informationM13 - Release 0.16Yifei XuOkoun-Ola Fabien HouetoYifei Xuhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/457release MongoDB implementation2023-08-18T22:21:00ZAleh Shubko [EPAM]release MongoDB implementation# Merge request template# Merge request templateM13 - Release 0.16Aleh Shubko [EPAM]Aleh Shubko [EPAM]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/456Update docs/tutorial/StorageService.md2023-08-18T22:21:02ZDebasis ChatterjeeUpdate docs/tutorial/StorageService.md# Merge request template# Merge request templateM13 - Release 0.16Debasis ChatterjeeDebasis Chatterjeehttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/455upgrade version to '0.16.0-rc1'2022-08-03T07:35:07ZAshwani Pandeyupgrade version to '0.16.0-rc1'upgrade core lib IBM version to '0.16.0-rc1'upgrade core lib IBM version to '0.16.0-rc1'M13 - Release 0.16Ashwani PandeyAshwani Pandeyhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/453update versions for core-lib-azure and os-core-common2022-09-16T08:25:03ZYauheni Lesnikauupdate versions for core-lib-azure and os-core-commonRemove snapshot versions for os-core-common and core-lib-azure for storage-core and storage-azureRemove snapshot versions for os-core-common and core-lib-azure for storage-core and storage-azureM13 - Release 0.16Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/445GONRG-5228: Added .dockerignore and .gitattributes2023-08-18T22:21:03ZKrisztian Molnar (EPAM)GONRG-5228: Added .dockerignore and .gitattributesM13 - Release 0.16Krisztian Molnar (EPAM)Krisztian Molnar (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/442fix the nullpointer when acl is null2023-08-18T22:21:05ZYauheni Lesnikaufix the nullpointer when acl is nullWe are observing corrupted records with null acl on some environments. And trying to figure out how it could happen. But before we need to expose some fix for this bug, because it blocks reindex process for the entire index.We are observing corrupted records with null acl on some environments. And trying to figure out how it could happen. But before we need to expose some fix for this bug, because it blocks reindex process for the entire index.M13 - Release 0.16Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/437[BUG FIX] create error message using response from OPA2022-09-15T23:29:08ZRostislav Vatolinvatolinrp@gmail.com[BUG FIX] create error message using response from OPA## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
Link to the issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/133
## Does this int...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
Link to the issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/133
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
No
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Tests are not passing when OPA flag is on
## What is the new/expected behavior?
Tests are passing when OPA flag is on
## Have you added/updated Unit Tests and Integration Tests?
Yes
## Any other useful information
NoM13 - Release 0.16Rostislav Vatolinvatolinrp@gmail.comRostislav Vatolinvatolinrp@gmail.comhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/434GONRG-5051: refactor dev2 pipeline2023-08-18T22:21:06ZNastassia Rabeichykava (EPAM)GONRG-5051: refactor dev2 pipeline# Merge request template# Merge request templateM13 - Release 0.16https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/433Gonrg 5061 refactor community pipeline2023-08-18T22:21:08ZSiarhei Symanovich (EPAM)Gonrg 5061 refactor community pipelineGonrg 5061 refactor community pipelineGonrg 5061 refactor community pipelineM13 - Release 0.16Siarhei Symanovich (EPAM)Siarhei Symanovich (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/431Common pipeline for preship env [GONRG-5050]2023-08-18T22:21:10ZMikhail Piatliou (EPAM)Common pipeline for preship env [GONRG-5050]# Merge request template# Merge request templateM13 - Release 0.16Mikhail Piatliou (EPAM)Mikhail Piatliou (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/427Bulk record creation API fix for MSI2023-08-18T22:21:12ZAnkur RawatBulk record creation API fix for MSICurrent Bulk Executor API used Document Client which is creeated with cosmos-primary-key.
To move to MSI, we need a client which can be created with DefaultCreds. Made changes for the same.Current Bulk Executor API used Document Client which is creeated with cosmos-primary-key.
To move to MSI, we need a client which can be created with DefaultCreds. Made changes for the same.M13 - Release 0.16Ankur RawatAnkur Rawathttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/426fix opa endpoint config (GONRG-5080)2022-09-10T09:09:15ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comfix opa endpoint config (GONRG-5080)## Type of change
- [x] Bug Fix
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does th...## Type of change
- [x] Bug Fix
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Property configuration of OPA endpoint combined with OPA service not working as it was planned,
value does not inject to the service, and during runtime, a NullPointer exception will occur when Storage tries to send request OPA endpoint.
And it no follow best practices as it said that configuration should be clean POJO objects.
https://www.baeldung.com/configuration-properties-in-spring-boot#simple-properties
## What is the new/expected behavior?
Property injects as it should be, via property file or via env variable.
## Have you added/updated Unit Tests and Integration Tests?
yes
## Any other useful information
This is a minor fix that will not require any changes in CSP configurations.M13 - Release 0.16Rustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/425Enabling OPA for AWS and Replacing ConfigProps with Value annotation2023-08-18T22:21:13ZMarc Burnie [AWS]Enabling OPA for AWS and Replacing ConfigProps with Value annotation- Enabling OPA for AWS on Storage
- Replaced @ConfigurationProperties with @Value annotation due to null OPA endpoint variable- Enabling OPA for AWS on Storage
- Replaced @ConfigurationProperties with @Value annotation due to null OPA endpoint variableM13 - Release 0.16Marc Burnie [AWS]Marc Burnie [AWS]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/423implement int tests for anthos env(GONRG-4979)2023-08-18T22:21:15ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comimplement int tests for anthos env(GONRG-4979)# Merge request template# Merge request templateM13 - Release 0.16Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/420Add redis properties2022-08-12T21:21:46ZAlok JoshiAdd redis propertiesCurrent default redis cache configuration (for groups cache for Azure) sets cache expiration time as 1 hour. This is an issue because 1 hour is too long, any recent changes on user's groups will not be picked up by the cache.
Scenario:
...Current default redis cache configuration (for groups cache for Azure) sets cache expiration time as 1 hour. This is an issue because 1 hour is too long, any recent changes on user's groups will not be picked up by the cache.
Scenario:
- User makes a Storage call with token 1
- A new group is created with Entitlements service and user is added to that group
- User makes a Storage call which requires user to be in this new group (which he/she is)
With 1 hour cache expiration, storage will fail to sync cache with this new membership, and return 403 for user. Thus, this expiration should be much lower.M13 - Release 0.16Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/418Remove read audit logs2023-08-18T22:21:18ZRostislav Vatolinvatolinrp@gmail.comRemove read audit logs## Type of change
- [YES] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/49
## Does this introduce a change i...## Type of change
- [YES] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/49
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
all read audit logs are being logged
## What is the new/expected behavior?
read audit logs can be turned off using entry (flag) in PartitionInfo table
## Have you added/updated Unit Tests and Integration Tests?
unit tests updatedM13 - Release 0.16