Wellbore Domain Services merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests2023-08-17T11:25:37Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/81Fix kind in conversion2023-08-17T11:25:37Zfabian serinFix kind in conversionFinx in the generated kind when doing wellbore and well conversionFinx in the generated kind when doing wellbore and well conversionM5 - Release 0.8https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/69fix L49 .gitlab-ci.yml2023-08-17T11:25:54ZOleksandr Kosse (EPAM)fix L49 .gitlab-ci.ymlfix line L49 (reference to nonexistent branch - was removed after MR https://community.opengroup.org/osdu/platform/ci-cd-pipelines/-/merge_requests/206)fix line L49 (reference to nonexistent branch - was removed after MR https://community.opengroup.org/osdu/platform/ci-cd-pipelines/-/merge_requests/206)M5 - Release 0.8https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/161fix limit and offset query parameters on log v22023-08-17T11:23:46ZJeremie Hallalfix limit and offset query parameters on log v2M7 - Release 0.10https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/57Fix loadschema.sh2023-08-17T11:26:12ZVincent RondotFix loadschema.shSmall fix on the script to load the schemasSmall fix on the script to load the schemasM5 - Release 0.8https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/248Fix /logs/{logid}/statistics response spec to reflect real API behavior2023-08-17T11:21:53ZLuc YriarteFix /logs/{logid}/statistics response spec to reflect real API behaviorAPI returns a dictionary of StatsColumn objects by column name, spec stated an array of unnamed StatsColumn objects.API returns a dictionary of StatsColumn objects by column name, spec stated an array of unnamed StatsColumn objects.M9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/727fix: Make Anthos/Ref logging level configurable2023-08-17T14:21:25ZYan Sushchynski (EPAM)fix: Make Anthos/Ref logging level configurableMake Anthos/Reference logging severity configurableMake Anthos/Reference logging severity configurableM17 - Release 0.20https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/47Fix merge error in requirements.txt2023-08-17T11:26:22ZLuc YriarteFix merge error in requirements.txtM5 - Release 0.8Luc YriarteLuc Yriartehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/379Fix new pipeline for gcp dev2 env and with new rules [GONRG-4182]2023-08-17T11:19:00ZMikhail Piatliou (EPAM)Fix new pipeline for gcp dev2 env and with new rules [GONRG-4182]M10 - Release 0.13Mikhail Piatliou (EPAM)Mikhail Piatliou (EPAM)https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/531fix nodepool setting in chart's deployment.yaml2023-08-17T11:16:11ZAlexandre Vincentfix nodepool setting in chart's deployment.yamlM12 - Release 0.15Alexandre VincentAlexandre Vincenthttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/198fix notice from fossa check output diff2023-08-17T11:22:52ZAlexandre Vincentfix notice from fossa check output diffM8 - Release 0.11Alexandre VincentAlexandre Vincenthttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/126Fix openapi file out of sync2023-08-17T11:24:36ZKin Jin NgFix openapi file out of sync- openapi.json auto generated spec file got out of sync- openapi.json auto generated spec file got out of syncM7 - Release 0.10https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/595fix perf bottle neck in function _get_curve_name_and_column_count2022-12-09T13:48:25ZYannickfix perf bottle neck in function _get_curve_name_and_column_countfix for #47
same goal as !594 but minimizing the changesfix for #47
same goal as !594 but minimizing the changesM13 - Release 0.16https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/625Fix pipeline after AWS changes2022-09-26T13:38:04ZLuc YriarteFix pipeline after AWS changeshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/375fix protocol issue on gcp2023-08-17T11:19:05ZJeremie Hallalfix protocol issue on gcpM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/262fix requirements_dev2023-08-17T11:21:39ZAlexandre Vincentfix requirements_devM9 - Release 0.12Alexandre VincentAlexandre Vincenthttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/338Fix return curve non existent2023-08-17T11:19:56ZYuli LiuFix return curve non existentWhen users send curves which don't exist, return 404When users send curves which don't exist, return 404M10 - Release 0.13Yuli LiuYuli Liuhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/35Fix security tests2023-08-17T11:26:37ZVincent RondotFix security testsM4 - Release 0.7https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/231fix set_bulk_uri doesn't merge extension properties2023-08-17T11:22:14ZChristophe Lallementfix set_bulk_uri doesn't merge extension propertiesWell Log's extension properties are overwritten by POST data apis in V3Well Log's extension properties are overwritten by POST data apis in V3M9 - Release 0.12Christophe LallementChristophe Lallementhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/409fix shutdown event2023-08-17T11:18:26ZAlexandre Vincentfix shutdown eventM11 - Release 0.14Alexandre VincentAlexandre Vincenthttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/139fix some bottleneck found during perf test failure investigation2023-08-17T11:24:17ZYannickfix some bottleneck found during perf test failure investigationfix some bottleneck found during perf test failure investigation. Fixes are:
On Azure lib, not in this MR [see corresponding MR](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbor...fix some bottleneck found during perf test failure investigation. Fixes are:
On Azure lib, not in this MR [see corresponding MR](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/22)
- Secret value pinned to partition info (cached from 5 minutes), _reason_ = get secret is done synchronous for each request causing the service to be unresponsive in average during 90ms.
- Add an asyncio lock after unsuccessfully checking cache, _reason_ = prevent unnecessary call to fetch partition info and lead to cache reset in case on multiple concurrency.
**WDMS Service, this MR**
- Extend backoff to exception client_storage.ResponseHandlingException, _reason_ = Error such as "server disconnected" are caught and rethrown as ResponseHandlingException. Is that case provide some resilience, which tends to occur during stress.
- Bulk data (de)serialization [done asynchronously](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/blob/fix_perf/app/bulk_persistence/dataframe_serializer.py#L110). _reason_ = this appears to be the main bottleneck during perf test. Since the task is done synchronously, (de)serialization of bulk may take few 10 ms to few seconds to complete. The service becomes fully unresponsive during this time. The fix is to execute these tasks inside process pool (in favor of a thread pool since it's a CPU bound operation) rather than synchronously inside the main thread. For now the pool size is arbitrary set to 4 (subject to change later).
There's also some [bootstrap mechanism](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/blob/fix_perf/app/wdms_app.py#L123) at service startup, so pool is fully ready at first incoming request.M7 - Release 0.10