Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2023-03-06T14:44:55Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/613Draft: Patch records api (in progress)2023-03-06T14:44:55ZAlok JoshiDraft: Patch records api (in progress)https://community.opengroup.org/osdu/platform/system/storage/-/issues/124https://community.opengroup.org/osdu/platform/system/storage/-/issues/124https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/612Upgrade First Party Library Dependencies for Release 0.192023-02-18T07:31:17ZDavid Diederichd.diederich@opengroup.orgUpgrade First Party Library Dependencies for Release 0.19This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any...This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any library that is older than the previous release will be left as-is, since the upgrade is likely to be more complicated.
Furthermore, the upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: 6ccebc445eb48ac1a19bc5fdf305017c14df1dee
Maven: 0.20.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------- | ------------------ |
| core-lib-azure | 0.19.0-rc5 | |
| core-lib-gcp | 0.19.0-rc5 | |
| os-core-lib-aws | 0.17.0 | 0.14.0-rc2 |
| obm | 0.19.0-rc4 | |
| oqm | 0.18.0 | |
| os-core-common | 0.19.0-rc3 | 0.13.0, 0.18.0-rc3 |
| os-core-lib-ibm | 0.17.0-rc4 | 0.17.0-rc4 |
| osm | 0.18.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.14.0 | 2.8.1, 2.13.2.2 |
| (3rd Party) org.springframework.spring-webflux | 5.3.22 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.22 | 5.3.12, 5.3.22 |
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade-3
SHA: 1fade6d667e0d7beffe7311810be98e5b6ba4a4c
Maven: 0.20.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------- | ------------------ |
| core-lib-azure | 0.19.0 | |
| core-lib-gcp | 0.19.0 | |
| os-core-lib-aws | 0.17.0 | 0.14.0-rc2 |
| obm | 0.19.0 | |
| oqm | 0.19.0 | |
| os-core-common | 0.19.0 | 0.13.0, 0.18.0-rc3 |
| os-core-lib-ibm | 0.17.0-rc4 | 0.17.0-rc4 |
| osm | 0.19.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.14.0 | 2.8.1, 2.13.2.2 |
| (3rd Party) org.springframework.spring-webflux | 5.3.24 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.22 | 5.3.12, 5.3.22 |M16 - Release 0.19https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/610Add springdoc openapi latest version2023-02-17T14:29:26ZThulasi Dass SubramanianAdd springdoc openapi latest version## Type of change
- [ ] Bug Fix
- [x] Feature
**Link to ADR(Architecture Decision Record)** : [Swagger using springdoc-openapi](https://community.opengroup.org/osdu/platform/system/home/-/issues/97)
## OpenAPI 3.0 related changes
- u...## Type of change
- [ ] Bug Fix
- [x] Feature
**Link to ADR(Architecture Decision Record)** : [Swagger using springdoc-openapi](https://community.opengroup.org/osdu/platform/system/home/-/issues/97)
## OpenAPI 3.0 related changes
- upgraded to latest **springdoc openapi** latest version [1.6.14](https://mvnrepository.com/artifact/org.springdoc/springdoc-openapi-ui/1.6.14)
- used [**@OpenAPIDefinition**](https://docs.swagger.io/swagger-core/v2.0.9/apidocs/io/swagger/v3/oas/annotations/OpenAPIDefinition.html) annotation to populate OpenAPI Object fields _[info, tags, servers, security]_
- Documented **Query, Record, Patch , Info & Health** API with OpenAPI 3.0 **Annotations**
- Added the standard HTTP Response(4xx, 5x****x) for API Responses
- Custom Path for
- **Swagger UI**: https://host/context-path/swagger (will redirect to https://host/context-path/swagger-ui/index.html)
- **api-docs (JSON)** : https://host/context-path/api-docs
- **api-docs (YAML)** : https://host/context-path/api-docs.yaml
## Other Changes
- **Configurable** descriptions managed in [swagger.properties](https://community.opengroup.org/osdu/platform/system/storage/-/blob/az/td-swagger-springdoc-openapi/storage-core/src/main/resources/swagger.properties)
- added **Integration Test** cases for _**Swagger-UI, api-docs**_ endpoints
- Hide **deprecated** [**Schema, PubSubEndpoints**] related API operations in documentation
- Deleted HomeController
## References
- https://springdoc.org/faq.html#_can_i_use_spring_property_with_swagger_annotations
- https://springdoc.org/migrating-from-springfox.htmlThulasi Dass SubramanianThulasi Dass Subramanianhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/615Security Fixes2023-02-10T17:48:25ZMarc Burnie [AWS]Security FixesIncludes: AWS Adding support for EKS 1.23Includes: AWS Adding support for EKS 1.23M16 - Release 0.19Marc Burnie [AWS]Marc Burnie [AWS]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/509Swagger Sanity Phase 2: Using springdoc-openapi for swaggers APIs2023-02-09T10:03:08ZDmitrii Novikov (EPAM)Swagger Sanity Phase 2: Using springdoc-openapi for swaggers APIs## Type of change
- [ ] Bug Fix
- [x] Feature
https://community.opengroup.org/osdu/platform/system/home/-/issues/97
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider imple...## Type of change
- [ ] Bug Fix
- [x] Feature
https://community.opengroup.org/osdu/platform/system/home/-/issues/97
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [x] AWS
- [x] Azure
- [x] GCP
- [x] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Using springfox library for swagger
## What is the new/expected behavior?
Using springdoc library for swagger
## Have you added/updated Unit Tests and Integration Tests?
Integration test for swagger endpoint addedSrinivasan NarayananSrinivasan Narayananhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/598Handling data inconsistency properly (GONRG-6319)2023-02-06T16:09:54ZKanstantsin Dubrouski [EPAM / GCP]Handling data inconsistency properly (GONRG-6319)Handling data inconsistency properlyHandling data inconsistency properlyM16 - Release 0.19Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/399Updated storage service to use RedisAzureCache2023-02-04T05:34:22ZShiv SinghUpdated storage service to use RedisAzureCache# Merge request template# Merge request templateShiv SinghShiv Singhhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/488fix api test2023-02-04T05:34:22ZNikhil Singh[MicroSoft]fix api test# Merge request template# Merge request templateNikhil Singh[MicroSoft]Nikhil Singh[MicroSoft]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/424Update Core-Lib-Azure Library Version2023-02-04T05:34:21ZAnubhav AronUpdate Core-Lib-Azure Library VersionOverview: Service use core-lib-azure as external dependency. Updating core-lib-azure version to add feature of adding logging frameworkOverview: Service use core-lib-azure as external dependency. Updating core-lib-azure version to add feature of adding logging frameworkAnubhav AronAnubhav Aronhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/489Updating POM of Storage Service to take up latest code from azure-core-lib2023-02-04T05:34:20ZSrishti SharmaUpdating POM of Storage Service to take up latest code from azure-core-lib# Merge request template
Issue: Stack trace is split across multiple line. Target: Reduce stack trace by having each exception without line breaks. Too many logs. Difficult to debug for DRIs.
Bug: https://dev.azure.com/OpenEnergyPlatfor...# Merge request template
Issue: Stack trace is split across multiple line. Target: Reduce stack trace by having each exception without line breaks. Too many logs. Difficult to debug for DRIs.
Bug: https://dev.azure.com/OpenEnergyPlatform/Open%20Energy%20Platform/\_workitems/edit/6422
1. Updated POM.xml of Storage Service to take up latest code version(0.17.0-rc6)from azure-core-lib i.e. <osdu.corelibazure.version>0.17.0-rc6</osdu.corelibazure.version>
2. Logging library is already updated with version 0.17.0-rc6 which removes line breaks in stack trace.
Target: Each exception in one line. Reduces log size.https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/460MSCOSDU-127 update deployment2023-02-04T05:34:15ZIgor Zimovets (EPAM)MSCOSDU-127 update deploymentChange motivation:
https://github.com/Azure/application-gateway-kubernetes-ingress/blob/master/docs/how-tos/minimize-downtime-during-deployments.mdChange motivation:
https://github.com/Azure/application-gateway-kubernetes-ingress/blob/master/docs/how-tos/minimize-downtime-during-deployments.mdhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/608message properties updated.2023-02-02T15:46:49ZAnfal Fadhilmessage properties updated.A small docs update MR. adding the new properties to the message.A small docs update MR. adding the new properties to the message.Anfal FadhilAnfal Fadhilhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/590Collaboration Feature Flag2023-01-17T18:19:06ZAnfal FadhilCollaboration Feature FlagAdded a partition specific feature flag for collaboration.Added a partition specific feature flag for collaboration.Anfal FadhilAnfal Fadhilhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/439DRAFT: add souts2022-12-22T18:27:03ZRostislav Vatolinvatolinrp@gmail.comDRAFT: add souts# Merge request template# Merge request templateRostislav Vatolinvatolinrp@gmail.comRostislav Vatolinvatolinrp@gmail.comhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/536DO NOT MERGE2022-12-22T18:20:13Zshivani karipeDO NOT MERGE# Merge request template# Merge request templatehttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/555Updating core-lib version2022-12-20T05:58:36ZAnkur RawatUpdating core-lib versionCosmosDb 4xx error handling is updated in 0.17.1-SNAPSHOT core-lib.CosmosDb 4xx error handling is updated in 0.17.1-SNAPSHOT core-lib.Ankur RawatAnkur Rawathttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/576Upgrade First Party Library Dependencies for Release 0.182022-12-13T12:39:56ZDavid Diederichd.diederich@opengroup.orgUpgrade First Party Library Dependencies for Release 0.18This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any...This automated MR upgrades the first party libraries (other OSDU libraries) to utilize the latest release.
The intent is to keep the OSDU projects utilizing the latest available code to ensure widespread usage and stability.
However, any library that is older than the previous release will be left as-is, since the upgrade is likely to be more complicated.
Furthermore, the upgrade should only be merged in the CI pipeline reports success.
If this MR has failed, we can spend a little time investigating to see if a trivial upgrade could achieve compatiblity to the new library.
But significant upgrade efforts should not occur on this MR, as part of the release tagging process.
Instead, significant work should be scheduled for a subsequent milestone.
### Dependency Information Before the Upgrade
```
Branch: master
SHA: c1c1bb933139f1688717d5d1e30cc871fb43fe94
Maven: 0.19.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ---------------------------------- | ------------------ |
| core-lib-azure | 0.18.0-rc4 | |
| core-lib-gcp | 0.18.0-rc4 | |
| os-core-lib-aws | 0.17.0 | 0.14.0-rc2 |
| obm | 0.18.0-rc3 | |
| oqm | 0.18.0-rc1 | |
| os-core-common | 0.19.0-rc1, 0.17.0-X-COLLABORATION | 0.13.0, 0.18.0-rc3 |
| os-core-lib-ibm | 0.17.0-rc4 | 0.17.0-rc4 |
| osm | 0.18.0-rc2 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.4.1 | 2.8.1, 2.13.2.2 |
| (3rd Party) org.springframework.spring-webflux | 5.3.22 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.22 | 5.3.12, 5.3.22 |
### Dependency Information After the Upgrade
```
Branch: dependency-upgrade-2
SHA: d26198684e213fde02f56b52a99c513541705b43
Maven: 0.19.0-SNAPSHOT
```
| Maven Dependencies | _Root_ | testing/ |
| ------------------------------------------------------- | ------------------ | --------------- |
| core-lib-azure | 0.19.0-rc1 | |
| core-lib-gcp | 0.18.0 | |
| os-core-lib-aws | 0.18.0 | 0.14.0-rc2 |
| obm | 0.18.0 | |
| oqm | 0.18.0 | |
| os-core-common | 0.19.0-rc1, 0.18.0 | 0.13.0, 0.18.0 |
| os-core-lib-ibm | 0.17.0-rc4 | 0.17.0-rc4 |
| osm | 0.18.0 | |
| (3rd Party) com.fasterxml.jackson.core.jackson-databind | 2.13.4.1 | 2.8.1, 2.13.2.2 |
| (3rd Party) org.springframework.spring-webflux | 5.3.22 | |
| (3rd Party) org.springframework.spring-webmvc | 5.3.22 | 5.3.12, 5.3.22 |M15 - Release 0.18https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/571Cherry-pick 'Update FOSSA NOTICE' into release/0.182022-12-09T19:58:08ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Update FOSSA NOTICE' into release/0.18**Original MR**: !567
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporati...**Original MR**: !567
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporating all changes in the default branch.
These MRs must be approved by the PMC before they are merged, since they alter the scope of the release.
To see more details about the change itself, look at the Original MR listed above.
#### Skipped Pipeline
Normally, pipelines are not executed on the cherry pick branch/MR prior to merging.
This optimization is accepted because the code was tested when it merged into the default branch, and will be tested again in the release branch prior to tagging.
However, if anybody feels that the MR requires further scrutiny -- whether because it had conflicts in the cherry-picking, it interfaces with some drastically altered logic between the branches, or any other reason -- we can run the pipeline here prior to merging.
#### If There's Reason to Run a Pipeline
If you want to see a pipeline result before this merges, first add a comment explaining why you'd like to see the pipeline results so the PMC and others know your thinking.
Then, mark the MR as a Draft MR (using the vertical ellipsis above, choose 'Mark as Draft').
This prevents the MR from being approved & merged accidentally by a busy release coordinator who didn't see your comment.
Finally, if you are a maintainer on the project, launch a pipeline on this branch.
Since this branch is a protected branch and the MR has ~no-detached-pipeline set, all integration tests will run and there's no need for any `trusted-*` branches.
[Launch a Pipeline for this Branch](https://community.opengroup.org/osdu/platform/system/storage/-/pipelines/new?ref=cherry-pick-for-567)M15 - Release 0.18David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/563[Testing]Update core-common to 0.18.0-rc4 for testing2022-12-07T16:29:12ZMina Otgonbold[Testing]Update core-common to 0.18.0-rc4 for testingUpdate core-common to 0.18.0-rc4 for testing the failure of IBM and gcp-anthos integration test failure.Update core-common to 0.18.0-rc4 for testing the failure of IBM and gcp-anthos integration test failure.https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/569GONRG-6045: Remove NEG annotation in service2022-12-06T11:35:06ZVolodymyr Pienskoi [EPAM / GCP]GONRG-6045: Remove NEG annotation in serviceServices created in GKE clusters 1.17.6-gke.7 and up with VPC-native traffic routing enabled are annotated automatically with `cloud.google.com/neg: '{"ingress": true}'`. This means that this annotation is not required explicitly and can...Services created in GKE clusters 1.17.6-gke.7 and up with VPC-native traffic routing enabled are annotated automatically with `cloud.google.com/neg: '{"ingress": true}'`. This means that this annotation is not required explicitly and can be removed.
More details in [GKE Load Balancing documentation](https://cloud.google.com/kubernetes-engine/docs/concepts/ingress#container-native_load_balancing).Volodymyr Pienskoi [EPAM / GCP]Volodymyr Pienskoi [EPAM / GCP]