Schema merge requestshttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests2021-06-17T10:52:15Zhttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/116Gcp fix schema uniqueness check2021-06-17T10:52:15ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comGcp fix schema uniqueness check# Description:
Fix response for schema creation in shared tenant, to respond 400 when some partition misconfigured
# Changes include:
- [x] Bugfix (a non-breaking change that solves an issue).
# Changes in:
- [x] GCP
# Dev Checkli...# Description:
Fix response for schema creation in shared tenant, to respond 400 when some partition misconfigured
# Changes include:
- [x] Bugfix (a non-breaking change that solves an issue).
# Changes in:
- [x] GCP
# Dev Checklist:
- [x] Added Unit Tests, wherever applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.
# Other comments:
Any comments to approvers hereM7 - Release 0.10Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/113Fixing supersededBy issue for SHARED partition2023-08-18T21:57:55ZAbhishek Kumar (SLB)Fixing supersededBy issue for SHARED partitionThere is a defect in the Azure module of `AzureSchemaInfoStore.java`.
**Steps to replicate:**
1. Create a schema with a schema with `SHARED` data-partition with `supersededBy` block.
2. Now, invoke schema GET endpoint with appropriate f...There is a defect in the Azure module of `AzureSchemaInfoStore.java`.
**Steps to replicate:**
1. Create a schema with a schema with `SHARED` data-partition with `supersededBy` block.
2. Now, invoke schema GET endpoint with appropriate filters: `authority`, `source`, `entityType` and `schemaVersionMajor` using `PRIVATE` partition. This call would fail because the search for `supersededBy` block happens in the `PRIVATE` partition where it doesn't exist.
**Root Cause**
Below code make a call to `getSchemaInfoObject(info.getFlattenedSchemaInfo())` without passing the dataPartitionID and it always looks for `supersededBy` block in the datapartition specified in the header (in this case `PRIVATE` where it doesn't exist):
```
List<SchemaInfo> schemaList = new LinkedList<>();
for (SchemaInfoDoc info: schemaInfoList)
{
schemaList.add(getSchemaInfoObject(info.getFlattenedSchemaInfo()));
}
```
**FIX**
Additional attribute i.e `dataPartitionId` should be supplied which will look for `supersededBy` block in the correct dataPartition always.
**Issue**
https://community.opengroup.org/osdu/platform/system/schema-service/-/issues/48M7 - Release 0.10Abhishek Kumar (SLB)Abhishek Kumar (SLB)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/119Schema: Implement Event Publishing for GCP (GONRG-2378)2021-06-29T10:12:06ZAnastasiia GelmutSchema: Implement Event Publishing for GCP (GONRG-2378)# Description:
Implemented event publishing.
# How to test:
Schema service can be tested with the help of business cases.
# Changes include:
- [ ] Refactor (a non-breaking change that improves code maintainability).
- [ ] Bugfix (a non...# Description:
Implemented event publishing.
# How to test:
Schema service can be tested with the help of business cases.
# Changes include:
- [ ] Refactor (a non-breaking change that improves code maintainability).
- [ ] Bugfix (a non-breaking change that solves an issue).
- [x] New feature (a non-breaking change that adds functionality).
- [ ] Breaking change (a change that is not backward-compatible and/or changes current functionality).
# Changes in:
- [x] GCP
- [ ] Azure
- [ ] AWS
- [ ] IBM
# Dev Checklist:
* [x] Added Unit Tests, wherever applicable.
* [x] Updated the Readme, if applicable.
* [x] Existing Tests pass
* [x] Verified functionality locally
* [x] Self Reviewed my code for formatting and complex business logic.M7 - Release 0.10Riabokon Stanislav(EPAM)[GCP]Rostislav Dublin (EPAM)Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/117[azure] Adding new API to create public schemas in azure2023-08-18T21:57:51ZAman Verma[azure] Adding new API to create public schemas in azureChanges in the MR:
===
1. A new azure only API named /system/schema
Find details here: https://community.opengroup.org/osdu/platform/system/schema-service/-/issues/51
2. The API works with service principal authorization only
3. All the ...Changes in the MR:
===
1. A new azure only API named /system/schema
Find details here: https://community.opengroup.org/osdu/platform/system/schema-service/-/issues/51
2. The API works with service principal authorization only
3. All the classes interacting with cosmosStore and blobStore have this intelligence added to identify whether any schema has to be created in system related cosmos/ blob or tenant specific cosmos/ blob. This identification is done using the data-partition-id header.
4. The older way of creating public schemas is still supported.
5. The new API sets data-partition-id as `shared.tenant.name` to induce the public schema scenraio.
6. Both entry points to create public schemas converge at provider/schema-azure level, hence all the public schemas would be created at system resources only. Even the older API is passing common as data-partition-id, in reality there is no common tenant; as far as public schemas are concerned.M7 - Release 0.10Aman VermaAman Vermahttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/118Adding integration tests schemas/system endpoint2023-08-18T21:57:49ZAman VermaAdding integration tests schemas/system endpointThis MR has API related changes https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/117
Most of the payload and test logic has been borrowed from schema-test-core and modified to work on azure CSP
cc: @...This MR has API related changes https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/117
Most of the payload and test logic has been borrowed from schema-test-core and modified to work on azure CSP
cc: @kibattul, @polavishnu, @harshit283M7 - Release 0.10Aman VermaAman Vermahttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/109Schema validation changes2022-09-16T09:02:44ZAbhishek Kumar (SLB)Schema validation changes**Schema Validation Changes**
There are new schema validations going to be performed everytime there is a create or update request. These changes are driven by below rules:
[SchemaChanges](https://gitlab.opengroup.org/osdu/subcommittee...**Schema Validation Changes**
There are new schema validations going to be performed everytime there is a create or update request. These changes are driven by below rules:
[SchemaChanges](https://gitlab.opengroup.org/osdu/subcommittees/data-def/work-products/schema/-/blob/master/_doc/SchemaChanges.md)
[[_TOC_]]
# Schema Changes
Schema modifications have to be done with great care as schemas can be
used to generate code and API specifications. Changes may or may not break
clients consuming the schemas.
The solution to this is the concept of [semantic versioning](https://semver.org).
General rules have been defined during the
[R3 cycle](R3-changes/SchemaCompositionAndVersioning.md) in this summary:
* _Given a version number `MAJOR.MINOR.PATCH`, increment the:_
* _`MAJOR` version when you make **incompatible schema** changes,_
* _`MINOR` version when you add functionality **or contents** in a backwards
compatible manner, and_
* _`PATCH` version when you make backwards compatible bug fixes **or documentation/decoration changes**._
# Schema Service
New schemas are registered with the Schema service. The Schema service checks
the incoming schema definition against the previous minor and/or patch version
should they exist.
## Permitted Changes for PATCH Version Increments
Changes to the values (text) of the following JSON tags:
1. `title`
1. `description`
1. `example`
1. `pattern`
1. `$id`
1. `$comment`
1. any JSON extension tag starting with `x-osdu`
## Permitted Changes for MINOR Version Increments
In addition to all permitted changes in PATCH versions, the following
actions are permitted:
1. adding properties to existing data and nested structures
1. adding object structures to
1. `allOf` arrays and
1. `oneOf` arrays.
Explicitly not permitted is changing
1. the list of `required` properties
1. the state of `additionalProperties`.
It is permitted to declare existing properties as deprecated, preferable with
instructions how to migrate from the previous to the next version. The documentation
will automatically mark properties with ~~strike-through~~ if the description starts
with `"DEPRECATED: "`.
## Permitted Changes for MAJOR Version Increments
Any changes are permitted, specifically
* removal of properties
* removal of structures in `allOf`, `oneOf`
* changing the list of `required` properties
* changing the state of `additionalProperties`.M7 - Release 0.10Abhishek Kumar (SLB)Abhishek Kumar (SLB)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/121non zero check added on limit2023-08-18T21:57:48ZGokul Nagarenon zero check added on limitM7 - Release 0.10Anuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/122Add helms for schema service [GONRG-2682]2023-08-18T21:57:46ZMikhail Piatliou (EPAM)Add helms for schema service [GONRG-2682]M7 - Release 0.10Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/125Added path to GCP helms [GONRG-2682]2023-08-18T21:57:45ZMikhail Piatliou (EPAM)Added path to GCP helms [GONRG-2682]M7 - Release 0.10Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/126Update GCP helms for schema [GONRG-2682]2023-08-18T21:57:43ZMikhail Piatliou (EPAM)Update GCP helms for schema [GONRG-2682]M7 - Release 0.10Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/131updating the core-lib-azure version in azure related pom.xml2023-08-18T21:57:42ZAman Vermaupdating the core-lib-azure version in azure related pom.xmlThe existing core-lib-azure version specified in provider/schema-azure/pom.xml is causing build failure. The version mentioned in pom.xml is `0.11.0-SNAPSHOT` while the latest available in package registry is `0.10.0-rc10`
Fixing the same.The existing core-lib-azure version specified in provider/schema-azure/pom.xml is causing build failure. The version mentioned in pom.xml is `0.11.0-SNAPSHOT` while the latest available in package registry is `0.10.0-rc10`
Fixing the same.M7 - Release 0.10Aman VermaAman Vermahttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/133AWS Updates2023-08-18T21:57:40ZSpencer Suttonsuttonsp@amazon.comAWS Updatescommit f7b32ee6
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Thu May 27 2021 10:15:59 GMT-0500 (Central Daylight Time)
"Excluding springs default security, locking down mvn central"commit f7b32ee6
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Thu May 27 2021 10:15:59 GMT-0500 (Central Daylight Time)
"Excluding springs default security, locking down mvn central"M7 - Release 0.10Spencer Suttonsuttonsp@amazon.comSpencer Suttonsuttonsp@amazon.comhttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/134Changed authorize_api to v22023-08-18T21:57:39ZOleksii Tsyganov (EPAM)Changed authorize_api to v2M7 - Release 0.10Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/129Resolve "Revised WellLog"2023-08-18T22:41:43ZThomas Gehrmann [slb]Resolve "Revised WellLog"Closes #47
Update to DD schema repo SHA 9218d461334082270de8e3745f7201d821d93dec 2021.07.08Closes #47
Update to DD schema repo SHA 9218d461334082270de8e3745f7201d821d93dec 2021.07.08M7 - Release 0.10Thomas Gehrmann [slb]Thomas Gehrmann [slb]https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/135(GONRG-2632) Gcp ci bootstrap2023-08-18T21:57:37ZOleksandr Kosse (EPAM)(GONRG-2632) Gcp ci bootstrapM8 - Release 0.11Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/136Added rollme annotation2023-08-18T21:57:36ZOleksii Tsyganov (EPAM)Added rollme annotationM8 - Release 0.11Oleksii Tsyganov (EPAM)Oleksii Tsyganov (EPAM)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/140fix ibm schema bootstrap issue2023-08-18T21:57:32ZAnuj Guptafix ibm schema bootstrap issueTo fix schema bootstrap issue as in integration tear-off database is not cleared. This fix will resolve the intermittent failure of ibm-testTo fix schema bootstrap issue as in integration tear-off database is not cleared. This fix will resolve the intermittent failure of ibm-testM8 - Release 0.11Gokul NagareGokul Nagarehttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/141Update resources limits [GONRG-2974]2023-08-18T21:57:31ZMikhail Piatliou (EPAM)Update resources limits [GONRG-2974]M8 - Release 0.11Oleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/139upgrade schema service to switch on partition service2023-08-18T21:57:34ZAshwani Pandeyupgrade schema service to switch on partition serviceUpgrade schema service to use Partition service for tenant validationUpgrade schema service to use Partition service for tenant validationM8 - Release 0.11Anuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/143Locking down maven central2021-08-05T09:23:28ZDzmitry_Paulouski (slb)Locking down maven centralcommit f7b32ee6
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Thu May 27 2021 10:15:59 GMT-0500 (Central Daylight Time)
"Excluding springs default security, locking down mvn central"commit f7b32ee6
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Thu May 27 2021 10:15:59 GMT-0500 (Central Daylight Time)
"Excluding springs default security, locking down mvn central"