Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2022-12-12T22:51:21Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/532consume latest version of core common library and update the way of getting p...2022-12-12T22:51:21ZKelly Zhouconsume latest version of core common library and update the way of getting parent recordsPlease refer to issue [here](https://community.opengroup.org/osdu/platform/system/storage/-/issues/145)Please refer to issue [here](https://community.opengroup.org/osdu/platform/system/storage/-/issues/145)M15 - Release 0.18https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/73Consume Partition service to provide multi-tenancy support in Storage-Azure2023-08-18T22:28:24ZAlok JoshiConsume Partition service to provide multi-tenancy support in Storage-Azure## Type of change
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementat...## Type of change
- [x] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [No]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] Azure
## Does this introduce a breaking change?
- [YES]
## What is the current behavior?
Current Azure implementation works in single tenancy mode. This implementation aims to provide multi-tenancy support via Partition service
## What is the new/expected behavior?
Provides multi-tenancy support via Partition service
## Have you added/updated Unit Tests and Integration Tests?
Yes
## Any other useful informationM1 - Release 0.1https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/605Conversion: validate records at the start using json schemas2023-03-10T13:17:20ZMykyta SavchukConversion: validate records at the start using json schemasThere is a bug, when SpatialLocation in record is array, storage returns 500 on batch. Example record data:
```
"SpatialLocation": [
{
"SpatialGeometryTypeID": "Point",
....
]
```
And there were a lot of sim...There is a bug, when SpatialLocation in record is array, storage returns 500 on batch. Example record data:
```
"SpatialLocation": [
{
"SpatialGeometryTypeID": "Point",
....
]
```
And there were a lot of similar bugs related to record geo data validation lately (like misspelling field names and so on, that resulted in 500), but the existing validation logic is not intuitive and is spread across the code with random checks, so to fix them we had to add different checks (if's) in different parts of the code, and to make this logic more robust and prevent future bugs it was decided to do a refactoring and place the validation in one place using json schemas, since we already have them, and remove any further validation checks. Also, as we already have a well defined schema for the SpatialLocation geo attribute, I added a validation for such case in addition to the existing generic geo attribute validation, which I also converted to json schema (GenericGeoAttribute.json).
- Changed conversion logic to add validation against the schema at the start of the flow;
- Removed unnecessary validation checks;
- In case of validation error, the message from validation library is returned, instead of constant predefined messages;
- I changed tests' data (unit and integration), because the schema for AnyCrsFeatureCollection says that if bbox is present, it should not be null, so I added a sample value.M17 - Release 0.20Chad LeongMykyta SavchukChad Leonghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/100copy parent pom for int tests2023-08-18T22:27:06ZMatt Wisecopy parent pom for int tests# Merge request template# Merge request templateM1 - Release 0.1Matt WiseMatt Wisehttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/331core lib upgrade to rc62023-08-18T22:22:10ZAshwani Pandeycore lib upgrade to rc6IBM core lib upgrade to rc6IBM core lib upgrade to rc6M10 - Release 0.13shitij singhshitij singhhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/638Corrected Mock parameters to fix tests2023-03-06T02:40:51ZAnkur RawatCorrected Mock parameters to fix testsUnit test fixUnit test fixAnkur RawatAnkur Rawathttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/531Correct the attribute name to "PreloadFilePath" for os-storage2023-08-18T22:20:52ZXiangliang MengCorrect the attribute name to "PreloadFilePath" for os-storage# Merge request template# Merge request templateM15 - Release 0.18Okoun-Ola Fabien HouetoXiangliang MengOkoun-Ola Fabien Houetohttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/132CORS Fix2021-03-05T21:22:52ZSpencer Suttonsuttonsp@amazon.comCORS Fix# Merge request template# Merge request templateSpencer Suttonsuttonsp@amazon.comSpencer Suttonsuttonsp@amazon.comhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/140CORS Fix, AWS Updates2023-08-18T22:25:00ZSpencer Suttonsuttonsp@amazon.comCORS Fix, AWS Updates# Merge request template# Merge request templateM4 - Release 0.7ethiraj krishnamanaiduWladmir FrazaoJoeDmitriy Rudkoethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/152CORS Fix Update2023-08-18T22:24:42ZSpencer Suttonsuttonsp@amazon.comCORS Fix Update# Merge request template# Merge request templateM4 - Release 0.7ethiraj krishnamanaiduDania Kodeih (Microsoft)Wladmir FrazaoJoeDmitriy RudkoMatt Wiseethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/429Cosmos primary key Fix for MSI2022-06-02T13:00:52ZAnkur RawatCosmos primary key Fix for MSICosmos primary key Fix for MSICosmos primary key Fix for MSIAnkur RawatAnkur Rawathttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/346Cosmos Query Optimizations2023-08-18T22:22:04ZVibhuti Sharma [Microsoft]Cosmos Query Optimizations# Merge request template# Merge request templateM11 - Release 0.14Vibhuti Sharma [Microsoft]Vibhuti Sharma [Microsoft]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/200Cosmos sdk bug fix : Allow creation of 2 or more records with IDs that have s...2023-08-18T22:23:52ZSmitha ManjunathCosmos sdk bug fix : Allow creation of 2 or more records with IDs that have same first 100 characters## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
PUT Record always failing with 500 error in case of multiple entities with long Ids that have same first 100 characters.
## What is the new/expected behavior?
Records should be created
## Have you added/updated Unit Tests and Integration Tests?
Yes-Integration test
## Any other useful informationM6 - Release 0.9Smitha ManjunathSmitha Manjunathhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/189create new headers instead modifying existing2023-08-18T22:24:09ZGokul Nagarecreate new headers instead modifying existing# Merge request template
Reason for changes in core to address issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/65
Fix for failing test cases because of policy integration to address issue: https://community....# Merge request template
Reason for changes in core to address issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/65
Fix for failing test cases because of policy integration to address issue: https://community.opengroup.org/osdu/platform/system/storage/-/issues/69M6 - Release 0.9Anuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/514[CRS normalization] Coordinates in the original CRS system are not preserved ...2022-09-30T11:40:28ZRiabokon Stanislav(EPAM)[GCP][CRS normalization] Coordinates in the original CRS system are not preserved in the index (GONRG-5581) Fixed issue https://community.opengroup.org/osdu/platform/system/indexer-service/-/issues/61 Fixed issue https://community.opengroup.org/osdu/platform/system/indexer-service/-/issues/61M14 - Release 0.17Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/155Cutting over to v22023-08-18T22:24:41ZJasonCutting over to v2# Merge request template# Merge request templateM5 - Release 0.8ethiraj krishnamanaiduJasonethiraj krishnamanaiduhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/710dataBootstrapEnabled for legal and schema (GONRG-7224)2023-06-09T09:07:30ZAndrei Skorkin [EPAM / GCP]dataBootstrapEnabled for legal and schema (GONRG-7224)# Merge request template# Merge request templateM19 - Release 0.22https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/118Decouple kind and tenant2023-08-18T22:25:25ZSviatoslav NekhaienkoDecouple kind and tenantCheck of a Data Partition ID has been removed from a Kind.
Please see https://community.opengroup.org/osdu/platform/system/storage/-/issues/42 for details.Check of a Data Partition ID has been removed from a Kind.
Please see https://community.opengroup.org/osdu/platform/system/storage/-/issues/42 for details.M1 - Release 0.1https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/261Default env variable value for schema endpoint2023-08-18T22:23:02ZKrishna Nikhil VedurumudiDefault env variable value for schema endpoint## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [ ] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [YES/NO]
## What is the current behavior?
Due to lack of default value, pipelines are broken with Storage service not coming up with error
```
***************************
APPLICATION FAILED TO START
***************************
Description:
Failed to bind properties under 'schema.endpoints.disabled' to boolean:
Property: schema.endpoints.disabled
Value:
Origin: System Environment Property "schema_endpoints_disabled"
Reason: failed to convert java.lang.String to boolean
Action:
Update your application's configuration
```
## What is the new/expected behavior?
Default value provided for application property `schema.endpoints.disabled`
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationM9 - Release 0.12Krishna Nikhil VedurumudiKrishna Nikhil Vedurumudihttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/534Delete all versions of the blob when purging a record2022-12-09T10:53:01ZAlok JoshiDelete all versions of the blob when purging a recordPlease refer to [issue ](https://community.opengroup.org/osdu/platform/system/storage/-/issues/147)
This change solves the samePlease refer to [issue ](https://community.opengroup.org/osdu/platform/system/storage/-/issues/147)
This change solves the sameM15 - Release 0.18Alok JoshiAlok Joshi