Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2023-08-18T22:22:47Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/272broken pipe IOException handler2023-08-18T22:22:47ZNeelesh Thakurbroken pipe IOException handlerStorage Service is throwing IOException with `Broken pipe` error message. This usually thrown when a client closes the connection while its request is still being processed in the server.
We should handle these properly so client can re...Storage Service is throwing IOException with `Broken pipe` error message. This usually thrown when a client closes the connection while its request is still being processed in the server.
We should handle these properly so client can retry.
Here is one of the stack trace:
![image](/uploads/3177e0f0678500da915bcb309725d955/image.png)M9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/269hash cosmodb cursor as it's too large causing issue for Istio envoy & Azure A...2023-08-18T22:22:50ZNeelesh Thakurhash cosmodb cursor as it's too large causing issue for Istio envoy & Azure App GateWayAddresses #[34](https://community.opengroup.org/osdu/platform/system/indexer-service/-/issues/34)Addresses #[34](https://community.opengroup.org/osdu/platform/system/indexer-service/-/issues/34)M9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/288Upgrade OSDU dependencies2021-10-27T17:17:15ZDavid Diederichd.diederich@opengroup.orgUpgrade OSDU dependencies# Merge request template# Merge request templateM9 - Release 0.12David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/286upgrade IBM test core lib version to 0.12.0-SNAPSHOT2023-08-18T22:22:37ZAshwani Pandeyupgrade IBM test core lib version to 0.12.0-SNAPSHOTupgrade IBM test core lib version to 0.12.0-SNAPSHOTupgrade IBM test core lib version to 0.12.0-SNAPSHOTM9 - Release 0.12Ashwani PandeyAshwani Pandeyhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/285Update to use latest core common2022-12-22T16:49:14ZAlok JoshiUpdate to use latest core commonPlease refer to this issue https://community.opengroup.org/osdu/platform/system/home/-/issues/90Please refer to this issue https://community.opengroup.org/osdu/platform/system/home/-/issues/90M9 - Release 0.12Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/282consume blobstorage fixes - throw explicit 503 when server is busy to process...2023-08-18T22:22:38ZNeelesh Thakurconsume blobstorage fixes - throw explicit 503 when server is busy to process BlobStorage request so client can retryRelated Azure Lib MR: [155](https://community.opengroup.org/osdu/platform/system/lib/cloud/azure/os-core-lib-azure/-/merge_requests/155)Related Azure Lib MR: [155](https://community.opengroup.org/osdu/platform/system/lib/cloud/azure/os-core-lib-azure/-/merge_requests/155)M9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/281Health check2023-08-18T22:22:40ZSmitha ManjunathHealth checkusing common.propertiesusing common.propertiesM9 - Release 0.12Smitha ManjunathSmitha Manjunathhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/279Added logback into GCP IT Module (GONRG-3445)2021-10-10T16:05:41ZRiabokon Stanislav(EPAM)[GCP]Added logback into GCP IT Module (GONRG-3445)## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM...## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
The id_token is exposed in int-tests logs
## What is the new/expected behavior?
The id_token logs are disabledM9 - Release 0.12Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/278For Records Queue Copy2023-08-18T22:22:42ZAnuj GuptaFor Records Queue Copy# Merge request template# Merge request templateM9 - Release 0.12Anuj GuptaShrikant GargAnuj Guptahttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/275GONRG-3398 - set default number of replicas for storage2023-08-18T22:22:43ZOleksandr Kosse (EPAM)GONRG-3398 - set default number of replicas for storageScale storage serviceScale storage serviceM9 - Release 0.12Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/274Add resource limits and hpa setup based on feature flag2022-07-12T15:38:48ZAlok JoshiAdd resource limits and hpa setup based on feature flagAdd autoscaling configuration and memory/cpu limits based on feature flagAdd autoscaling configuration and memory/cpu limits based on feature flagM9 - Release 0.12Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/273Upgrading core-lib-azure version2023-08-18T22:22:45ZAbhishek PatilUpgrading core-lib-azure version# Merge request template# Merge request templateM9 - Release 0.12Abhishek PatilAbhishek Patilhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/271respond with 503 for too many cosmosdb request2023-08-18T22:22:48ZNeelesh Thakurrespond with 503 for too many cosmosdb requestM9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/270Revert maven-surefire-plugin version2021-10-15T15:37:30ZAlok JoshiRevert maven-surefire-plugin versionRefer this [issue](https://community.opengroup.org/osdu/platform/system/storage/-/issues/90)Refer this [issue](https://community.opengroup.org/osdu/platform/system/storage/-/issues/90)M9 - Release 0.12Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/268bulk soft delete record api2023-08-18T22:22:53ZYauheni Lesnikaubulk soft delete record apiNew API to perform soft delete for bulk of records. Related ADR: https://community.opengroup.org/osdu/platform/system/storage/-/issues/83New API to perform soft delete for bulk of records. Related ADR: https://community.opengroup.org/osdu/platform/system/storage/-/issues/83M9 - Release 0.12Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/267Add Virtual Service2023-08-18T22:22:54ZSanjeev-SLBAdd Virtual ServiceIssue [32](https://community.opengroup.org/osdu/platform/system/notification/-/issues/32)Issue [32](https://community.opengroup.org/osdu/platform/system/notification/-/issues/32)M9 - Release 0.12Sanjeev-SLBSanjeev-SLBhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/265Handle invalid coordinates for AsIngestedCoordinates payload2023-08-18T22:22:58ZSanjeev-SLBHandle invalid coordinates for AsIngestedCoordinates payloadHandle invalid coordinates dimension size for AsIngestedCoordinates payload, fixed Storage batch request 5xx errors for the following payload:
`"data": {``
"Name": "MultiPolygon",
"SpatialLocation": {
"AsIngestedCoordinates": {
"...Handle invalid coordinates dimension size for AsIngestedCoordinates payload, fixed Storage batch request 5xx errors for the following payload:
`"data": {``
"Name": "MultiPolygon",
"SpatialLocation": {
"AsIngestedCoordinates": {
"features": [{
"geometry": {
"coordinates": [
[
[
[
313405.9477893702,
6544797.620047403
],
[
314405.9477893702,
6564797.620047403
],
[
312405.9477893702,
6554797.620047403
],
[
313405.9477893702,
6544797.620047403
]
]
],
[
[
313405.9477893702,
6544797.620047403
],
[
324405.9477893702,
6664797.620047403
],
[
322405.9477893702,
6654797.620047403
],
[
313405.9477893702,
6544797.620047403
]
]
],
"bbox": null,
"type": "AnyCrsMultiPolygon"
},
"bbox": null,
"properties": {},
"type": "AnyCrsFeature"
}],
"bbox": null,
"properties": {},
"persistableReferenceCrs": "{\"lateBoundCRS\":{\"wkt\":\"PROJCS[\\\"ED_1950_UTM_Zone_32N\\\",GEOGCS[\\\"GCS_European_1950\\\",DATUM[\\\"D_European_1950\\\",SPHEROID[\\\"International_1924\\\",6378388.0,297.0]],PRIMEM[\\\"Greenwich\\\",0.0],UNIT[\\\"Degree\\\",0.0174532925199433]],PROJECTION[\\\"Transverse_Mercator\\\"],PARAMETER[\\\"False_Easting\\\",500000.0],PARAMETER[\\\"False_Northing\\\",0.0],PARAMETER[\\\"Central_Meridian\\\",9.0],PARAMETER[\\\"Scale_Factor\\\",0.9996],PARAMETER[\\\"Latitude_Of_Origin\\\",0.0],UNIT[\\\"Meter\\\",1.0],AUTHORITY[\\\"EPSG\\\",23032]]\",\"ver\":\"PE_10_3_1\",\"name\":\"ED_1950_UTM_Zone_32N\",\"authCode\":{\"auth\":\"EPSG\",\"code\":\"23032\"},\"type\":\"LBC\"},\"singleCT\":{\"wkt\":\"GEOGTRAN[\\\"ED_1950_To_WGS_1984_23\\\",GEOGCS[\\\"GCS_European_1950\\\",DATUM[\\\"D_European_1950\\\",SPHEROID[\\\"International_1924\\\",6378388.0,297.0]],PRIMEM[\\\"Greenwich\\\",0.0],UNIT[\\\"Degree\\\",0.0174532925199433]],GEOGCS[\\\"GCS_WGS_1984\\\",DATUM[\\\"D_WGS_1984\\\",SPHEROID[\\\"WGS_1984\\\",6378137.0,298.257223563]],PRIMEM[\\\"Greenwich\\\",0.0],UNIT[\\\"Degree\\\",0.0174532925199433]],METHOD[\\\"Position_Vector\\\"],PARAMETER[\\\"X_Axis_Translation\\\",-116.641],PARAMETER[\\\"Y_Axis_Translation\\\",-56.931],PARAMETER[\\\"Z_Axis_Translation\\\",-110.559],PARAMETER[\\\"X_Axis_Rotation\\\",0.893],PARAMETER[\\\"Y_Axis_Rotation\\\",0.921],PARAMETER[\\\"Z_Axis_Rotation\\\",-0.917],PARAMETER[\\\"Scale_Difference\\\",-3.52],AUTHORITY[\\\"EPSG\\\",1612]]\",\"ver\":\"PE_10_3_1\",\"name\":\"ED_1950_To_WGS_1984_23\",\"authCode\":{\"auth\":\"EPSG\",\"code\":\"1612\"},\"type\":\"ST\"},\"ver\":\"PE_10_3_1\",\"name\":\"ED50 * EPSG-Nor N62 2001 / UTM zone 32N [23032,1612]\",\"authCode\":{\"auth\":\"SLB\",\"code\":\"23032023\"},\"type\":\"EBC\"}",
"persistableReferenceUnitZ": "{\"scaleOffset\":{\"scale\":1.0,\"offset\":0.0},\"symbol\":\"m\",\"baseMeasurement\":{\"ancestry\":\"Length\",\"type\":\"UM\"},\"type\":\"USO\"}",
"type": "AnyCrsFeatureCollection"
}
}
}
}`M9 - Release 0.12Sanjeev-SLBSanjeev-SLBhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/264fix issue with impossibility of retrieving version with changed kind2023-08-18T22:22:59ZYauheni Lesnikaufix issue with impossibility of retrieving version with changed kindFix the issue when the version can't be retrieved because of changed kind.
Issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/89Fix the issue when the version can't be retrieved because of changed kind.
Issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/89M9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/263GCP Anthos update (GONRG-2881)2021-09-06T13:59:38ZRiabokon Stanislav(EPAM)[GCP]GCP Anthos update (GONRG-2881)## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [X] IB...## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [X] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationM9 - Release 0.12Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/262Mr fix trusted2023-08-18T22:23:01ZRitika KaushalMr fix trusted# Merge request template
reverted few rebase mistakes# Merge request template
reverted few rebase mistakesM9 - Release 0.12Ritika KaushalRitika Kaushal