Partition merge requestshttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests2022-08-05T09:34:10Zhttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/224GONRG-5182-external-postgresql-anthos-df2022-08-05T09:34:10ZSiarhei Symanovich (EPAM)GONRG-5182-external-postgresql-anthos-dfAdded external database.Added external database.Siarhei Symanovich (EPAM)Siarhei Symanovich (EPAM)https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/309GONRG-6045: Remove NEG annotation in service2022-12-06T11:32:10ZVolodymyr Pienskoi [EPAM / GCP]GONRG-6045: Remove NEG annotation in serviceServices created in GKE clusters 1.17.6-gke.7 and up with VPC-native traffic routing enabled are annotated automatically with `cloud.google.com/neg: '{"ingress": true}'`. This means that this annotation is not required explicitly and can...Services created in GKE clusters 1.17.6-gke.7 and up with VPC-native traffic routing enabled are annotated automatically with `cloud.google.com/neg: '{"ingress": true}'`. This means that this annotation is not required explicitly and can be removed.
More details in [GKE Load Balancing documentation](https://cloud.google.com/kubernetes-engine/docs/concepts/ingress#container-native_load_balancing).Volodymyr Pienskoi [EPAM / GCP]Volodymyr Pienskoi [EPAM / GCP]https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/525[GONRG-9205]: Rename var DATA_PARTITION_ID_LIST2024-03-13T14:19:32ZMykola Ronik [EPAM / GCP][GONRG-9205]: Rename var DATA_PARTITION_ID_LISTRenamed var DATA_PARTITION_ID_LIST and fixed bootstrap scriptRenamed var DATA_PARTITION_ID_LIST and fixed bootstrap scriptMykola Ronik [EPAM / GCP]Mykola Ronik [EPAM / GCP]https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/56Handling system partition in partition service2021-06-23T10:02:12ZAman VermaHandling system partition in partition serviceThis MR introduces logic to handle `system partition` for azure.
Proposed changes:
===
1. Users should be able to create/ update `system` partition using POST/ PATCH methods.
2. Details for `system` partition should be retrievable using...This MR introduces logic to handle `system partition` for azure.
Proposed changes:
===
1. Users should be able to create/ update `system` partition using POST/ PATCH methods.
2. Details for `system` partition should be retrievable using `get` method.
3. `system` partition would not be listed via `list()` call.
4. `system` partition cannot be deleted using `delete` call.
Change details:
===
Added logic to handle aforementioned cases.
Added UTs
cc: @polavishnu / @krveduru
PS: The `system` partition is the new way of handling shared resources in azure. This is not a full-fledged tenant, but a mere encapsulation of system/ shared resources.Aman VermaAman Vermahttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/102Health check2022-04-18T13:55:39ZSmitha ManjunathHealth checkusing common.propertiesusing common.propertiesSmitha ManjunathSmitha Manjunathhttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/232Ibm helm amq fix2022-07-12T08:06:00ZKaliprasanna BasuIbm helm amq fixKaliprasanna BasuKaliprasanna Basuhttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/270Ibm helm test for merge2022-09-27T17:48:33ZAnuj GuptaIbm helm test for mergehttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/215Ibm helm test post install2022-06-20T08:25:18ZAnuj GuptaIbm helm test post installAnuj GuptaAnuj Guptahttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/147Implement in-service encryption as a replacement for KMS (GONRG-4300)2022-02-21T13:20:00ZAnastasiia GelmutImplement in-service encryption as a replacement for KMS (GONRG-4300)# Description:
Implement in-service encryption as a replacement for KMS
Separate README.md into GCP and Anthos
# Changes include:
- [x] Refactor (a non-breaking change that improves code maintainability).
- [ ] Bugfix (a non-b...# Description:
Implement in-service encryption as a replacement for KMS
Separate README.md into GCP and Anthos
# Changes include:
- [x] Refactor (a non-breaking change that improves code maintainability).
- [ ] Bugfix (a non-breaking change that solves an issue).
- [x] New feature (a non-breaking change that adds functionality).
- [ ] Breaking change (a change that is not backward-compatible and/or changes current functionality).
# Changes in:
- [x] GCP
- [ ] Azure
- [ ] AWS
- [ ] IBM
# Dev Checklist:
- [ ] Added Unit Tests, wherever applicable.
- [x] Updated the Readme, if applicable.
- [x] Existing Tests pass
- [x] Verified functionality locally
- [x] Self Reviewed my code for formatting and complex business logic.Riabokon Stanislav(EPAM)[GCP]Riabokon Stanislav(EPAM)[GCP]https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/9Initial Azure Pipeline Addition2021-01-17T16:26:49ZDaniel SchollInitial Azure Pipeline AdditionThis is an initial pipeline additionThis is an initial pipeline additionDaniel SchollDaniel Schollhttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/328jar type vulnerability fix for partition-service2023-02-09T17:19:33ZPintu Guptajar type vulnerability fix for partition-serviceFollowing cve has been fix with this mr :
| cve | link |
|------------------|-------------------------------------------------|
| CVE-2022-25857 | https://nvd.nist.gov/vuln/detai...Following cve has been fix with this mr :
| cve | link |
|------------------|-------------------------------------------------|
| CVE-2022-25857 | https://nvd.nist.gov/vuln/detail/CVE-2022-25857 |
| CVE-2022-23181 | https://nvd.nist.gov/vuln/detail/CVE-2022-23181 |
| CVE-2022-42252 | https://nvd.nist.gov/vuln/detail/CVE-2022-42252 |
| PRISMA-2022-0239 | https://github.com/square/okhttp/issues/6738 |
| CVE-2022-22965 | https://nvd.nist.gov/vuln/detail/CVE-2022-22965 |
| CVE-2022-42003 | https://nvd.nist.gov/vuln/detail/CVE-2022-42003 |
| CVE-2022-42004 | https://nvd.nist.gov/vuln/detail/CVE-2022-42004 |Pintu GuptaPintu Guptahttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/296M14 upgrade2022-11-16T13:01:57ZAnkur RawatM14 upgradeM12 changes into M14M12 changes into M14Ankur RawatAnkur Rawathttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/431Merge branch 'gc-add-property' into 'master'2023-08-31T18:04:54ZYauheni Rykhter (EPAM)Merge branch 'gc-add-property' into 'master'GONRG-7705: add property to partition
See merge request osdu/platform/system/partition!430
(cherry picked from commit fa2fadf141ffc68939e7536e5be4316a558a09a5)
f89e8c8f GONRG-7705: add property to partition
d50f19c2 GONRG-7648: add pr...GONRG-7705: add property to partition
See merge request osdu/platform/system/partition!430
(cherry picked from commit fa2fadf141ffc68939e7536e5be4316a558a09a5)
f89e8c8f GONRG-7705: add property to partition
d50f19c2 GONRG-7648: add propertyM20 - Release 0.23Yauheni Rykhter (EPAM)Yauheni Rykhter (EPAM)https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/437Merge branch 'gc-fix-bug' into 'master'2023-09-01T10:19:10ZYauheni Rykhter (EPAM)Merge branch 'gc-fix-bug' into 'master'GONRG-7705: fix bug
See merge request osdu/platform/system/partition!435GONRG-7705: fix bug
See merge request osdu/platform/system/partition!435M20 - Release 0.23David Diederichd.diederich@opengroup.orgChad LeongYauheni Rykhter (EPAM)Srinivasan NarayananDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/152Move MongoDB to core lib2022-03-17T16:24:11ZAleh Shubko [EPAM]Move MongoDB to core lib- Migrate to core lib
- fix connection pools- Migrate to core lib
- fix connection poolsM11 - Release 0.14Aleh Shubko [EPAM]Marc Burnie [AWS]Aleh Shubko [EPAM]https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/160osdu-gcp update sa names in cluster2023-02-04T05:29:53ZAliaksandr Ramanovich (EPAM)osdu-gcp update sa names in clusterupdate sa names in clusterupdate sa names in clusterOleksandr Kosse (EPAM)Oleksandr Kosse (EPAM)https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/55Removed CPU limits to honor the resource limits set by namespace2021-05-19T13:57:08ZKrishna Nikhil VedurumudiRemoved CPU limits to honor the resource limits set by namespace## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provi...## Type of change
- [x] Bug Fix
- [ ] Feature
**Please provide link to gitlab issue or ADR(Architecture Decision Record)**
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
## What is the new/expected behavior?
The CPU limits will be picked up as what are set as default by the namespace.
## Have you added/updated Unit Tests and Integration Tests?
## Any other useful informationhttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/286remove obsolete properties2023-01-18T10:39:39ZRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comremove obsolete propertiesM16 - Release 0.19Rustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comRustam Lotsmanenko (EPAM)rustam_lotsmanenko@epam.comhttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/336Revert "Merge branch 'az/dk-azure-storage-sdk-to-datatables' into 'master'"2023-01-17T14:19:07ZDeepa KumariRevert "Merge branch 'az/dk-azure-storage-sdk-to-datatables' into 'master'"This reverts merge request !332
Issue found out after deployment in azureThis reverts merge request !332
Issue found out after deployment in azureDeepa KumariDeepa Kumarihttps://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/87There are latencies (more than 300 seconds) on Partition API.2021-08-27T19:04:04ZDmitrii GerashchenkoThere are latencies (more than 300 seconds) on Partition API.https://community.opengroup.org/osdu/platform/system/partition/-/issues/16
An inspection showed that there is 2 minutes timeout for Azure TableStorage which can be the cause of the latencies.
10 minutes latency reproduced locally with ...https://community.opengroup.org/osdu/platform/system/partition/-/issues/16
An inspection showed that there is 2 minutes timeout for Azure TableStorage which can be the cause of the latencies.
10 minutes latency reproduced locally with the following conditions:
1. Endpoints GET /api/partition/v1/partitions or /api/partition/v1/partitions/{partitionId}
2. Not data in cache.
3. Azure Table storage is unavailable or responding too slow.
4. Many requests to API (more than 500).
Presumably, if a cache became outdated during high-load many simultaneous requests are send to TableStorage.
All requests which were sent before TableStorage response caching will create new requests to TableStorage and will be waiting for response up to 2 minutes. Finally, the API latency grows.
The solution is to use a cluster lock during the request to TableStorage. It's a copy of this solution from the Entitlements repository:
https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/blob/master/provider/entitlements-v2-azure/src/main/java/org/opengroup/osdu/entitlements/v2/azure/service/GroupCacheServiceAzure.java#L81
@Qualifier("cachedPartitionServiceImpl") was removed to make the bean "CachedPartitionServiceImpl" overridable.
CachedPartitionServiceImpl (defined in partition-core) was redefined with ProviderCachedPartitionServiceImpl (defined in partition-azure).
CachedPartitionService interface was introduced to resolve ambiguities for beans CachedPartitionService and PartitionServiceImpl. Both of them inherit IPartitionService. Now CachedPartitionService resolves ambiguities instead of @Qualifier("cachedPartitionServiceImpl").
New code was tested with the same conditions and the latency didn't grow.Dmitrii GerashchenkoDmitrii Gerashchenko