Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2023-08-18T22:22:42Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/278For Records Queue Copy2023-08-18T22:22:42ZAnuj GuptaFor Records Queue Copy# Merge request template# Merge request templateM9 - Release 0.12Anuj GuptaShrikant GargAnuj Guptahttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/275GONRG-3398 - set default number of replicas for storage2023-08-18T22:22:43ZOleksandr Kosse (EPAM)GONRG-3398 - set default number of replicas for storageScale storage serviceScale storage serviceM9 - Release 0.12Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/274Add resource limits and hpa setup based on feature flag2022-07-12T15:38:48ZAlok JoshiAdd resource limits and hpa setup based on feature flagAdd autoscaling configuration and memory/cpu limits based on feature flagAdd autoscaling configuration and memory/cpu limits based on feature flagM9 - Release 0.12Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/273Upgrading core-lib-azure version2023-08-18T22:22:45ZAbhishek PatilUpgrading core-lib-azure version# Merge request template# Merge request templateM9 - Release 0.12Abhishek PatilAbhishek Patilhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/272broken pipe IOException handler2023-08-18T22:22:47ZNeelesh Thakurbroken pipe IOException handlerStorage Service is throwing IOException with `Broken pipe` error message. This usually thrown when a client closes the connection while its request is still being processed in the server.
We should handle these properly so client can re...Storage Service is throwing IOException with `Broken pipe` error message. This usually thrown when a client closes the connection while its request is still being processed in the server.
We should handle these properly so client can retry.
Here is one of the stack trace:
![image](/uploads/3177e0f0678500da915bcb309725d955/image.png)M9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/271respond with 503 for too many cosmosdb request2023-08-18T22:22:48ZNeelesh Thakurrespond with 503 for too many cosmosdb requestM9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/270Revert maven-surefire-plugin version2021-10-15T15:37:30ZAlok JoshiRevert maven-surefire-plugin versionRefer this [issue](https://community.opengroup.org/osdu/platform/system/storage/-/issues/90)Refer this [issue](https://community.opengroup.org/osdu/platform/system/storage/-/issues/90)M9 - Release 0.12Alok JoshiAlok Joshihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/269hash cosmodb cursor as it's too large causing issue for Istio envoy & Azure A...2023-08-18T22:22:50ZNeelesh Thakurhash cosmodb cursor as it's too large causing issue for Istio envoy & Azure App GateWayAddresses #[34](https://community.opengroup.org/osdu/platform/system/indexer-service/-/issues/34)Addresses #[34](https://community.opengroup.org/osdu/platform/system/indexer-service/-/issues/34)M9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/268bulk soft delete record api2023-08-18T22:22:53ZYauheni Lesnikaubulk soft delete record apiNew API to perform soft delete for bulk of records. Related ADR: https://community.opengroup.org/osdu/platform/system/storage/-/issues/83New API to perform soft delete for bulk of records. Related ADR: https://community.opengroup.org/osdu/platform/system/storage/-/issues/83M9 - Release 0.12Yauheni LesnikauYauheni Lesnikauhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/267Add Virtual Service2023-08-18T22:22:54ZSanjeev-SLBAdd Virtual ServiceIssue [32](https://community.opengroup.org/osdu/platform/system/notification/-/issues/32)Issue [32](https://community.opengroup.org/osdu/platform/system/notification/-/issues/32)M9 - Release 0.12Sanjeev-SLBSanjeev-SLBhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/265Handle invalid coordinates for AsIngestedCoordinates payload2023-08-18T22:22:58ZSanjeev-SLBHandle invalid coordinates for AsIngestedCoordinates payloadHandle invalid coordinates dimension size for AsIngestedCoordinates payload, fixed Storage batch request 5xx errors for the following payload:
`"data": {``
"Name": "MultiPolygon",
"SpatialLocation": {
"AsIngestedCoordinates": {
"...Handle invalid coordinates dimension size for AsIngestedCoordinates payload, fixed Storage batch request 5xx errors for the following payload:
`"data": {``
"Name": "MultiPolygon",
"SpatialLocation": {
"AsIngestedCoordinates": {
"features": [{
"geometry": {
"coordinates": [
[
[
[
313405.9477893702,
6544797.620047403
],
[
314405.9477893702,
6564797.620047403
],
[
312405.9477893702,
6554797.620047403
],
[
313405.9477893702,
6544797.620047403
]
]
],
[
[
313405.9477893702,
6544797.620047403
],
[
324405.9477893702,
6664797.620047403
],
[
322405.9477893702,
6654797.620047403
],
[
313405.9477893702,
6544797.620047403
]
]
],
"bbox": null,
"type": "AnyCrsMultiPolygon"
},
"bbox": null,
"properties": {},
"type": "AnyCrsFeature"
}],
"bbox": null,
"properties": {},
"persistableReferenceCrs": "{\"lateBoundCRS\":{\"wkt\":\"PROJCS[\\\"ED_1950_UTM_Zone_32N\\\",GEOGCS[\\\"GCS_European_1950\\\",DATUM[\\\"D_European_1950\\\",SPHEROID[\\\"International_1924\\\",6378388.0,297.0]],PRIMEM[\\\"Greenwich\\\",0.0],UNIT[\\\"Degree\\\",0.0174532925199433]],PROJECTION[\\\"Transverse_Mercator\\\"],PARAMETER[\\\"False_Easting\\\",500000.0],PARAMETER[\\\"False_Northing\\\",0.0],PARAMETER[\\\"Central_Meridian\\\",9.0],PARAMETER[\\\"Scale_Factor\\\",0.9996],PARAMETER[\\\"Latitude_Of_Origin\\\",0.0],UNIT[\\\"Meter\\\",1.0],AUTHORITY[\\\"EPSG\\\",23032]]\",\"ver\":\"PE_10_3_1\",\"name\":\"ED_1950_UTM_Zone_32N\",\"authCode\":{\"auth\":\"EPSG\",\"code\":\"23032\"},\"type\":\"LBC\"},\"singleCT\":{\"wkt\":\"GEOGTRAN[\\\"ED_1950_To_WGS_1984_23\\\",GEOGCS[\\\"GCS_European_1950\\\",DATUM[\\\"D_European_1950\\\",SPHEROID[\\\"International_1924\\\",6378388.0,297.0]],PRIMEM[\\\"Greenwich\\\",0.0],UNIT[\\\"Degree\\\",0.0174532925199433]],GEOGCS[\\\"GCS_WGS_1984\\\",DATUM[\\\"D_WGS_1984\\\",SPHEROID[\\\"WGS_1984\\\",6378137.0,298.257223563]],PRIMEM[\\\"Greenwich\\\",0.0],UNIT[\\\"Degree\\\",0.0174532925199433]],METHOD[\\\"Position_Vector\\\"],PARAMETER[\\\"X_Axis_Translation\\\",-116.641],PARAMETER[\\\"Y_Axis_Translation\\\",-56.931],PARAMETER[\\\"Z_Axis_Translation\\\",-110.559],PARAMETER[\\\"X_Axis_Rotation\\\",0.893],PARAMETER[\\\"Y_Axis_Rotation\\\",0.921],PARAMETER[\\\"Z_Axis_Rotation\\\",-0.917],PARAMETER[\\\"Scale_Difference\\\",-3.52],AUTHORITY[\\\"EPSG\\\",1612]]\",\"ver\":\"PE_10_3_1\",\"name\":\"ED_1950_To_WGS_1984_23\",\"authCode\":{\"auth\":\"EPSG\",\"code\":\"1612\"},\"type\":\"ST\"},\"ver\":\"PE_10_3_1\",\"name\":\"ED50 * EPSG-Nor N62 2001 / UTM zone 32N [23032,1612]\",\"authCode\":{\"auth\":\"SLB\",\"code\":\"23032023\"},\"type\":\"EBC\"}",
"persistableReferenceUnitZ": "{\"scaleOffset\":{\"scale\":1.0,\"offset\":0.0},\"symbol\":\"m\",\"baseMeasurement\":{\"ancestry\":\"Length\",\"type\":\"UM\"},\"type\":\"USO\"}",
"type": "AnyCrsFeatureCollection"
}
}
}
}`M9 - Release 0.12Sanjeev-SLBSanjeev-SLBhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/264fix issue with impossibility of retrieving version with changed kind2023-08-18T22:22:59ZYauheni Lesnikaufix issue with impossibility of retrieving version with changed kindFix the issue when the version can't be retrieved because of changed kind.
Issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/89Fix the issue when the version can't be retrieved because of changed kind.
Issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/89M9 - Release 0.12https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/263GCP Anthos update (GONRG-2881)2021-09-06T13:59:38ZRiabokon Stanislav(EPAM)[GCP]GCP Anthos update (GONRG-2881)## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [X] IB...## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [X] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
## What is the new/expected behavior?
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationM9 - Release 0.12Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/262Mr fix trusted2023-08-18T22:23:01ZRitika KaushalMr fix trusted# Merge request template
reverted few rebase mistakes# Merge request template
reverted few rebase mistakesM9 - Release 0.12Ritika KaushalRitika Kaushalhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/261Default env variable value for schema endpoint2023-08-18T22:23:02ZKrishna Nikhil VedurumudiDefault env variable value for schema endpoint## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES/NO]
## What is the current behavior?
Due to lack of default value, pipelines are broken with Storage service not coming up with error
```
***************************
APPLICATION FAILED TO START
***************************
Description:
Failed to bind properties under 'schema.endpoints.disabled' to boolean:
Property: schema.endpoints.disabled
Value:
Origin: System Environment Property "schema_endpoints_disabled"
Reason: failed to convert java.lang.String to boolean
Action:
Update your application's configuration
```
## What is the new/expected behavior?
Default value provided for application property `schema.endpoints.disabled`
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationM9 - Release 0.12Krishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/373Cherry-pick 'upgraded azure-core lib version' into 'release/0.13'2022-02-22T17:13:16ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'upgraded azure-core lib version' into 'release/0.13'Original MR: !370Original MR: !370M10 - Release 0.13David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/365Upgrading core library dependencies2022-02-08T18:20:42ZDavid Diederichd.diederich@opengroup.orgUpgrading core library dependenciesM10 - Release 0.13David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/363Update Azure /query/kinds API2022-02-08T16:04:10ZAkanksha PrasadUpdate Azure /query/kinds API# Merge request template
The change will enable to get all distinct kinds from StorageRecord
Original MR: !357# Merge request template
The change will enable to get all distinct kinds from StorageRecord
Original MR: !357M10 - Release 0.13Akanksha PrasadAkanksha Prasadhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/359Cherry-pick ' Upgrade dependencies' into 'release/0.13'2022-02-04T19:01:42ZDavid Diederichd.diederich@opengroup.orgCherry-pick ' Upgrade dependencies' into 'release/0.13'Original MR: !356Original MR: !356M10 - Release 0.13David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/357Update Azure /query/kinds API2022-03-22T09:00:58ZAkanksha PrasadUpdate Azure /query/kinds API# Merge request template
This change is returning all distinct kinds stored in StorageRecord table
This MR is to resolve this issue :https://community.opengroup.org/osdu/platform/system/storage/-/issues/100# Merge request template
This change is returning all distinct kinds stored in StorageRecord table
This MR is to resolve this issue :https://community.opengroup.org/osdu/platform/system/storage/-/issues/100M10 - Release 0.13Akanksha PrasadAkanksha Prasad