Storage merge requestshttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests2023-08-18T22:20:44Zhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/583upd request for storage deploy2023-08-18T22:20:44ZAliaksandr Ramanovich (EPAM)upd request for storage deploydecrease memory requestsdecrease memory requestsM16 - Release 0.19Aliaksandr Ramanovich (EPAM)Aliaksandr Ramanovich (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/599[GONRG-6340] Deploy redis by storage helm2023-08-18T22:20:42ZOleksandr Kosse (EPAM)[GONRG-6340] Deploy redis by storage helm# Merge request template# Merge request templateM16 - Release 0.19https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/602GONRG-6319 Data inconsistency handling2023-08-18T22:20:41ZKanstantsin Dubrouski [EPAM / GCP]GONRG-6319 Data inconsistency handlingData inconsistency handlingData inconsistency handlingM16 - Release 0.19Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/603GC use full image name2023-08-18T22:20:39ZAliaksandr Ramanovich (EPAM)GC use full image nameUse full name for docker imagesUse full name for docker imagesM16 - Release 0.19Aliaksandr Ramanovich (EPAM)Aliaksandr Ramanovich (EPAM)https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/604GONRG-6337: Remove audience from GC README2023-08-18T22:20:36ZVolodymyr Pienskoi [EPAM / GCP]GONRG-6337: Remove audience from GC READMEM16 - Release 0.19Volodymyr Pienskoi [EPAM / GCP]Volodymyr Pienskoi [EPAM / GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/587Vulnerability fix ibm storage service2023-03-30T08:07:19ZPintu GuptaVulnerability fix ibm storage serviceFollowing CVE has been fix into this MR :
| cve | link |
|------------------|-------------------------------------------------|
| PRISMA-2022-0239 | https://github.com/square/okhtt...Following CVE has been fix into this MR :
| cve | link |
|------------------|-------------------------------------------------|
| PRISMA-2022-0239 | https://github.com/square/okhttp/issues/6738 |
| CVE-2022-42003 | https://nvd.nist.gov/vuln/detail/CVE-2022-42003 |
| CVE-2022-42004 | https://nvd.nist.gov/vuln/detail/CVE-2022-42004 |
| CVE-2022-25857 | https://nvd.nist.gov/vuln/detail/CVE-2022-25857 |
| CVE-2022-22965 | https://nvd.nist.gov/vuln/detail/CVE-2022-22965 |
| CVE-2022-25647 | https://nvd.nist.gov/vuln/detail/CVE-2022-25647 |
| CVE-2022-42252 | https://nvd.nist.gov/vuln/detail/CVE-2022-42252 |
| CVE-2022-22965 | https://nvd.nist.gov/vuln/detail/CVE-2022-22965 |M16 - Release 0.19Pintu GuptaPintu Guptahttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/622Generate Swagger using springdoc-openapi2023-03-21T11:34:32ZThulasi Dass SubramanianGenerate Swagger using springdoc-openapi## Type of change
- [ ] Bug Fix
- [x] Feature
**Link to ADR(Architecture Decision Record)** : [Swagger using springdoc-openapi](https://community.opengroup.org/osdu/platform/system/home/-/issues/97)
## OpenAPI 3.0 related changes
- u...## Type of change
- [ ] Bug Fix
- [x] Feature
**Link to ADR(Architecture Decision Record)** : [Swagger using springdoc-openapi](https://community.opengroup.org/osdu/platform/system/home/-/issues/97)
## OpenAPI 3.0 related changes
- upgraded to latest **springdoc openapi** latest version [1.6.14](https://mvnrepository.com/artifact/org.springdoc/springdoc-openapi-ui/1.6.14)
- used [**@OpenAPIDefinition**](https://docs.swagger.io/swagger-core/v2.0.9/apidocs/io/swagger/v3/oas/annotations/OpenAPIDefinition.html) annotation to populate OpenAPI Object fields _[info, tags, servers, security]_
- Documented **Query, Record, Patch , Info & Health** API with OpenAPI 3.0 **Annotations**
- Added the standard HTTP Response(4xx, 5x****x) for API Responses
- Custom Path for
- **Swagger UI**: https://host/context-path/swagger (will redirect to https://host/context-path/swagger-ui/index.html)
- **api-docs (JSON)** : https://host/context-path/api-docs
- **api-docs (YAML)** : https://host/context-path/api-docs.yaml
## Other Changes
- **Configurable** descriptions managed in [swagger.properties](https://community.opengroup.org/osdu/platform/system/storage/-/blob/az/td-swagger-springdoc-openapi/storage-core/src/main/resources/swagger.properties)
- added **Integration Test** cases for _**Swagger-UI, api-docs**_ endpoints
- Hide **deprecated** [**Schema, PubSubEndpoints**] related API operations in documentation
- Deleted HomeController
## References
- https://springdoc.org/faq.html#_can_i_use_spring_property_with_swagger_annotations
- https://springdoc.org/migrating-from-springfox.htmlM16 - Release 0.19Thulasi Dass SubramanianThulasi Dass Subramanianhttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/653Filter metadata records by partition id2023-03-17T16:38:34ZMorris EstepaFilter metadata records by partition id## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/storage/-/issues/167
## Does this introduce a change in ...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
https://community.opengroup.org/osdu/platform/system/storage/-/issues/167
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Records from other partitions are returned when querying the service
## What is the new/expected behavior?
Only records from the target data partition are returned.
## Have you added/updated Unit Tests and Integration Tests?
Yes
## Any other useful informationM16 - Release 0.19Morris EstepaMorris Estepahttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/655Merge branch 'aws-merge-to-release-0.19' to 'release/0.19'2023-03-17T16:38:33ZMorris EstepaMerge branch 'aws-merge-to-release-0.19' to 'release/0.19'Original MR: !653
Merge branch 'aws-merge-to-release-0.19' to 'release/0.19'Original MR: !653
Merge branch 'aws-merge-to-release-0.19' to 'release/0.19'M16 - Release 0.19Chad LeongChad Leonghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/646Increase AWS container memory2023-03-10T18:59:10ZManish JangidIncrease AWS container memory# Merge request template
Increase AWS container memory
https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/645# Merge request template
Increase AWS container memory
https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/645M16 - Release 0.19https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/645Allocating more memory to container than JVM heap memory2023-03-10T18:24:54ZManish JangidAllocating more memory to container than JVM heap memory# Merge request template
Updating container memory# Merge request template
Updating container memoryM16 - Release 0.19https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/640Increase memory limits to 1.8GB2023-03-10T09:28:47ZMorris EstepaIncrease memory limits to 1.8GB## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [X] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Memory limit is at 900MB
## What is the new/expected behavior?
Memory limit is at 1.8GB
## Have you added/updated Unit Tests and Integration Tests?
No
## Any other useful informationM16 - Release 0.19Morris EstepaMorris Estepahttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/641Cherry pick increased memory limits change to release/0.192023-03-10T09:28:46ZMorris EstepaCherry pick increased memory limits change to release/0.19Original merge https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/640Original merge https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/640M16 - Release 0.19David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/633GONRG-6646: Add variable for disabling OPA2023-03-07T09:32:34ZVolodymyr Pienskoi [EPAM / GCP]GONRG-6646: Add variable for disabling OPAAdded `opaEnabled` value to Helm chart that disables OPA by default.Added `opaEnabled` value to Helm chart that disables OPA by default.M16 - Release 0.19Volodymyr Pienskoi [EPAM / GCP]Volodymyr Pienskoi [EPAM / GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/637Cherry-pick 'Adding EDS DMS to Allowed Principals' into release/0.192023-03-03T08:35:58ZMarc Burnie [AWS]Cherry-pick 'Adding EDS DMS to Allowed Principals' into release/0.19Original MR: https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/636
AWS DevOps/infrastructure change only.
Bug fix for unreported issue for AWS EDS DMS service.Original MR: https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/636
AWS DevOps/infrastructure change only.
Bug fix for unreported issue for AWS EDS DMS service.M16 - Release 0.19David Diederichd.diederich@opengroup.orgMarc Burnie [AWS]David Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/636Adding EDS DMS to Allowed Principals2023-03-02T13:55:39ZMarc Burnie [AWS]Adding EDS DMS to Allowed PrincipalsAWS Infrastructure change only.AWS Infrastructure change only.M16 - Release 0.19Marc Burnie [AWS]Marc Burnie [AWS]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/635Cherry-pick: GONRG-6646: Add variable for disabling OPA2023-03-01T21:28:13ZVolodymyr Pienskoi [EPAM / GCP]Cherry-pick: GONRG-6646: Add variable for disabling OPAGONRG-6646: Add variable for disabling OPA
See merge request !633
(cherry-picked from commit 91f0f5ff)
9b86fa5c GONRG-6646: Add variable for disabling OPAGONRG-6646: Add variable for disabling OPA
See merge request !633
(cherry-picked from commit 91f0f5ff)
9b86fa5c GONRG-6646: Add variable for disabling OPAM16 - Release 0.19Volodymyr Pienskoi [EPAM / GCP]Volodymyr Pienskoi [EPAM / GCP]https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/628Cherry-pick 'Generate Swagger using springdoc-openapi' into release/0.192023-02-17T17:42:57ZChad LeongCherry-pick 'Generate Swagger using springdoc-openapi' into release/0.19**Original MR**: !622
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporati...**Original MR**: !622
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporating all changes in the default branch.
These MRs must be approved by the PMC before they are merged, since they alter the scope of the release.
To see more details about the change itself, look at the Original MR listed above.
#### Skipped Pipeline
Normally, pipelines are not executed on the cherry pick branch/MR prior to merging.
This optimization is accepted because the code was tested when it merged into the default branch, and will be tested again in the release branch prior to tagging.
However, if anybody feels that the MR requires further scrutiny -- whether because it had conflicts in the cherry-picking, it interfaces with some drastically altered logic between the branches, or any other reason -- we can run the pipeline here prior to merging.
#### If There's Reason to Run a Pipeline
If you want to see a pipeline result before this merges, first add a comment explaining why you'd like to see the pipeline results so the PMC and others know your thinking.
Then, mark the MR as a Draft MR (using the vertical ellipsis above, choose 'Mark as Draft').
This prevents the MR from being approved & merged accidentally by a busy release coordinator who didn't see your comment.
Finally, if you are a maintainer on the project, launch a pipeline on this branch.
Since this branch is a protected branch and the MR has ~no-detached-pipeline set, all integration tests will run and there's no need for any `trusted-*` branches.
[Launch a Pipeline for this Branch](https://community.opengroup.org/osdu/platform/system/storage/-/pipelines/new?ref=cherry-pick-for-622)M16 - Release 0.19David Diederichd.diederich@opengroup.orgChad LeongSrinivasan NarayananDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/629Cherry-pick 'Bypass info and swagger apis in collaboration filter' into relea...2023-02-17T17:40:13ZDavid Diederichd.diederich@opengroup.orgCherry-pick 'Bypass info and swagger apis in collaboration filter' into release/0.19**Original MR**: !626
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporati...**Original MR**: !626
### This MR is a Cherry Pick into a Release Branch.
After the release branch is first created, any subsequent changes use this process to update the release (often resulting in a new patch tag) without incorporating all changes in the default branch.
These MRs must be approved by the PMC before they are merged, since they alter the scope of the release.
To see more details about the change itself, look at the Original MR listed above.
#### Skipped Pipeline
Normally, pipelines are not executed on the cherry pick branch/MR prior to merging.
This optimization is accepted because the code was tested when it merged into the default branch, and will be tested again in the release branch prior to tagging.
However, if anybody feels that the MR requires further scrutiny -- whether because it had conflicts in the cherry-picking, it interfaces with some drastically altered logic between the branches, or any other reason -- we can run the pipeline here prior to merging.
#### If There's Reason to Run a Pipeline
If you want to see a pipeline result before this merges, first add a comment explaining why you'd like to see the pipeline results so the PMC and others know your thinking.
Then, mark the MR as a Draft MR (using the vertical ellipsis above, choose 'Mark as Draft').
This prevents the MR from being approved & merged accidentally by a busy release coordinator who didn't see your comment.
Finally, if you are a maintainer on the project, launch a pipeline on this branch.
Since this branch is a protected branch and the MR has ~no-detached-pipeline set, all integration tests will run and there's no need for any `trusted-*` branches.
[Launch a Pipeline for this Branch](https://community.opengroup.org/osdu/platform/system/storage/-/pipelines/new?ref=cherry-pick-for-626)M16 - Release 0.19David Diederichd.diederich@opengroup.orgChad LeongSrinivasan NarayananDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/626Bypass info and swagger apis in collaboration filter2023-02-17T17:39:10ZAlok JoshiBypass info and swagger apis in collaboration filterCollaborationFilter, when enabled with data partition feature flag strategy, makes a call to Partition service. This call requires data-partition-id header, which is not passed to certain apis (info, swagger, health, etc), thus the api c...CollaborationFilter, when enabled with data partition feature flag strategy, makes a call to Partition service. This call requires data-partition-id header, which is not passed to certain apis (info, swagger, health, etc), thus the api call fails.
We can short-circuit the CollaborationFilter class when url contains one of theseM16 - Release 0.19Alok JoshiAlok Joshi