Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2023-08-18T22:23:26Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/223Update README.md2023-08-18T22:23:26ZRiabokon Stanislav(EPAM)[GCP]Update README.md# Merge request template# Merge request templateM7 - Release 0.10Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/222Update PolicyService-Integration.md2023-08-18T22:23:27ZRiabokon Stanislav(EPAM)[GCP]Update PolicyService-Integration.mdUpdate PolicyService-Integration.mdUpdate PolicyService-Integration.mdM7 - Release 0.10https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/221Gcp iam migration (GONRG-2518)2021-06-28T15:05:34ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comGcp iam migration (GONRG-2518)Starting July 1, 2021, calls to SignBlob and SignJwt (also known as JSON Web Tokens (JWT)) on the IAM API will no longer be supported and may fail.
Google is deprecating both authentication methods on: https://iam.googleapis.com
Instead...Starting July 1, 2021, calls to SignBlob and SignJwt (also known as JSON Web Tokens (JWT)) on the IAM API will no longer be supported and may fail.
Google is deprecating both authentication methods on: https://iam.googleapis.com
Instead, we can now use: https://iamcredentials.googleapis.com
We must migrate our projects off the IAM API to the new IAMCredentials API to avoid a service disruption. The IAMCredentials API supports higher traffic volumes across the network, giving you better access and reliability.M7 - Release 0.10Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/220GONRG-2577: heln chart added partition variable and changed resource api temp...2023-08-18T22:23:29ZAliaksandr Lubouski (EPAM)GONRG-2577: heln chart added partition variable and changed resource api templationghelm chart added partition variable and changed resource api templatinghelm chart added partition variable and changed resource api templatingM7 - Release 0.10https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/219Bug Fix: Storage errors when redis cache is being patched2023-08-18T22:23:30ZMina OtgonboldBug Fix: Storage errors when redis cache is being patched- Related issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/70
- The same redis fallback logic is implemented in [search service](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requ...- Related issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/70
- The same redis fallback logic is implemented in [search service](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/105/diffs).M7 - Release 0.10Mina OtgonboldMina Otgonboldhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/218Update legal tag compliance2022-09-16T01:32:34ZAkansha Rajput[Microsoft]Update legal tag compliance## Type of change
- [ Feature ]
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
When a legal tag change happens or if it expires, we need to accordingly update the records with the invalid legal tags and ...## Type of change
- [ Feature ]
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
When a legal tag change happens or if it expires, we need to accordingly update the records with the invalid legal tags and accordingly notify further in the system to have them not visible for search and other use cases.
This MR changes contain storage side wiring for the events from legal service on tag expiration.
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- Azure
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Storage service Azure has no subscriber logic to it, this MR focuses on adding that logic and using that to subscribe legal tag changed event.
It further process that event and updates the compliance on invalidated records.
## What is the new/expected behavior?
Storage service will subscribe to legal tag change event and update compliance accordingly.
## Have you added/updated Unit Tests and Integration Tests?
Yes - Added relevant unit tests.
## Any other useful information
Please find flow and design details here https://dev.azure.com/ms-slb-cobuild/ms-slb-delfi-collab/_workitems/edit/259M7 - Release 0.10https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/217Unit conversion update: support inhomogeneous nested array items2023-08-18T22:23:32ZKelly ZhouUnit conversion update: support inhomogeneous nested array itemsConsume changes in core library: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/94
Related issue: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/43Consume changes in core library: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/94
Related issue: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/43M7 - Release 0.10https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/216Unit conversion update: support homogeneous nested array items2023-08-18T22:23:34ZKelly ZhouUnit conversion update: support homogeneous nested array itemsConsume changes in core library: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/92
related issue: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/43Consume changes in core library: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/92
related issue: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/43M7 - Release 0.10https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/215Minor improvements for helms [GONRG-2627]2023-08-18T22:23:35ZMikhail Piatliou (EPAM)Minor improvements for helms [GONRG-2627]# Merge request template# Merge request templateM7 - Release 0.10Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/214Add LegalTag clean-up to the Storage int tests (GONRG-1013)2022-09-16T08:56:44ZArtem Dobrynin (EPAM)Add LegalTag clean-up to the Storage int tests (GONRG-1013)## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud prov...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Legal tags are not fully deleted after integration tests
## What is the new/expected behavior?
Legal tags are deleted after integration tests
## Have you added/updated Unit Tests and Integration Tests?
- [YES]
## Any other useful informationM7 - Release 0.10Rostislav Dublin (EPAM)Rostislav Dublin (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/213Use debug logs instead of info logs2023-08-18T22:23:37ZAlok JoshiUse debug logs instead of info logs1. Upgrade core-lib-azure library to make use of info to debug log changes in the latest RC version
1. Incorporate debug logs into Storage service. This is an effort to reduce the cost associated with storing trace (info) logs.1. Upgrade core-lib-azure library to make use of info to debug log changes in the latest RC version
1. Incorporate debug logs into Storage service. This is an effort to reduce the cost associated with storing trace (info) logs.M7 - Release 0.10Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/210Failing tests fix2023-08-18T22:23:38ZHema Vishnu Pola [Microsoft]Failing tests fix## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud p...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES/NO]
## What is the current behavior?
Core common function signature changed, which needs to be taken into the service changes.
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful information
Link to the changed core-common MR: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/86M7 - Release 0.10https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/209GONRG-2478 Added helm charts2023-08-18T22:23:40ZOleksii Tsyganov (EPAM)GONRG-2478 Added helm charts# Merge request template# Merge request templateM7 - Release 0.10Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/201add log ignoring for /actuator/health health check;2023-08-18T22:23:51ZYauheni Lesnikauadd log ignoring for /actuator/health health check;# Merge request template# Merge request templateM7 - Release 0.10Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/198add parent records version validation for ingestion service2023-08-18T22:23:56ZYauheni Lesnikauadd parent records version validation for ingestion serviceThis changes intended to validate the versions of the parent records. Related issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/72
```
"ancestry": {
"parents": [
"opendes:test:1.1.1624531545880:1...This changes intended to validate the versions of the parent records. Related issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/72
```
"ancestry": {
"parents": [
"opendes:test:1.1.1624531545880:1624531548953602"
]
}
```M7 - Release 0.10ethiraj krishnamanaiduNitin-slbNeelesh ThakurSherman YangAlok Joshiashley kelhamYauheni LesnikauKrishna Nikhil VedurumudiSanjeev-SLBethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/196fix for skipdupes=true for integer bug2023-08-18T22:23:59ZMina Otgonboldfix for skipdupes=true for integer bug- Fix for skipdupes=true for integer bug.
- Change from gson to Jackson.
- Issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/67
- Waiting MR: https://community.opengroup.org/osdu/platform/system/lib/core/os-co...- Fix for skipdupes=true for integer bug.
- Change from gson to Jackson.
- Issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/67
- Waiting MR: https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/merge_requests/84M7 - Release 0.10Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/260Disable failing schema as it is passing with a manual check and these routes ...2021-08-30T18:55:02ZMatt WiseDisable failing schema as it is passing with a manual check and these routes are no longer used anyway# Merge request template# Merge request templateM8 - Release 0.11David Diederichd.diederich@opengroup.orgMatt WiseDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/256AWS Fixes2023-08-18T22:23:06ZMatt WiseAWS Fixes# Merge request template# Merge request templateM8 - Release 0.11Matt WiseMatt Wisehttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/254Provide default value false to schema endpoint config2023-08-18T22:23:08ZKrishna Nikhil VedurumudiProvide default value false to schema endpoint config## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud p...## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [YES/NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES/NO]
## What is the current behavior?
## What is the new/expected behavior?
Provide default value to schema endpoint disablement feature flag.
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationM8 - Release 0.11https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/253handle erroneous AsIngestedCoordinates payload2023-08-18T22:23:09ZNeelesh Thakurhandle erroneous AsIngestedCoordinates payloadHandle erroneous AsIngestedCoordinates payload, Storage batch request fails with 500 error code for following payload:
```json
"data": {
"SpatialLocation": {
"AsIngestedCoordinates": {
"Type": "AnyCrsFeatureCollection"...Handle erroneous AsIngestedCoordinates payload, Storage batch request fails with 500 error code for following payload:
```json
"data": {
"SpatialLocation": {
"AsIngestedCoordinates": {
"Type": "AnyCrsFeatureCollection",
"CoordinateReferenceSystemID": "NAD27",
"VerticalCoordinateReferenceSystemID": null,
"PersistableReferenceCrs": null,
"PersistableReferenceVerticalCrs": null,
"PersistableReferenceUnitZ": null,
"Features": [
{
"Type": "AnyCrsFeature",
"Properties": null,
"Geometry": {
"Coordinates": [
30.8793048,
-87.7801454
],
"Type": "AnyCrsPoint",
"Bbox": null
}
}
],
"Bbox": null
},
"Wgs84Coordinates": null
}
}
```M8 - Release 0.11