Wellbore-azure-lib merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests2021-07-08T08:16:10Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/23Draft: Dask account key2021-07-08T08:16:10ZYannickDraft: Dask account keyhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/22keep secret value to avoid multiple sync call to the keyvault2023-08-17T22:29:10ZYannickkeep secret value to avoid multiple sync call to the keyvaultBased on investigation around performance tests, get_secret is done synchronously blocking the service until the response get back (in average 90ms).
The changes here is to 'pin' the value/secret once fetched to the partitionInfo which i...Based on investigation around performance tests, get_secret is done synchronously blocking the service until the response get back (in average 90ms).
The changes here is to 'pin' the value/secret once fetched to the partitionInfo which is cached for 5 minutes. As further improvement, we could turn this call into an asynchronous one (and then optionality then the pin of secret may no longer be necessary).
In addition, an async lock has been in the fetch partition info since in multiple concurrency several income request can pass and leading to several fetch which will reset the cache and then add to synchronous the secret.M7 - Release 0.10https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/21use dash instead of forbidden underscore in container name2023-08-17T22:29:12ZYannickuse dash instead of forbidden underscore in container nameuse dash instead of forbidden underscore in container name. Azurite latest version 2021.6 now check that.use dash instead of forbidden underscore in container name. Azurite latest version 2021.6 now check that.M7 - Release 0.10https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/20Draft: Async partition service2021-06-23T13:23:15ZYannickDraft: Async partition serviceDraft: Async partition serviceDraft: Async partition servicehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/19logging blob storage and data patition service2023-08-17T22:29:14ZChristophe Lallementlogging blob storage and data patition servicelogging blob storage and data partition service for troubleshoot getdefaultAzureCredential and error 500 in performance testslogging blob storage and data partition service for troubleshoot getdefaultAzureCredential and error 500 in performance testsM7 - Release 0.10Christophe LallementChristophe Lallementhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/18Logging2023-08-17T22:29:15ZChristophe LallementLoggingAdd logging for blob storage and partition service in order to troubleshoot performance issue and errors 500 with getDefaultAzureCredentialsAdd logging for blob storage and partition service in order to troubleshoot performance issue and errors 500 with getDefaultAzureCredentialsM7 - Release 0.10Christophe LallementChristophe Lallementhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/17[DRAFT] Add logger2021-06-04T13:57:02ZChristophe Lallement[DRAFT] Add loggerChristophe LallementChristophe Lallementhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/16[DRAFT] add logger and enable http logging for credentials and clients2021-06-03T12:08:39ZChristophe Lallement[DRAFT] add logger and enable http logging for credentials and clientsTry to add logger and enablet logging for azure crednetials and blobstorage client for troubleshooting error 500 when acquire credentials.Try to add logger and enablet logging for azure crednetials and blobstorage client for troubleshooting error 500 when acquire credentials.Christophe LallementChristophe Lallementhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/15Draft: keep secret value to avoid multiple sync calls to the keyvault2021-06-21T15:12:03ZYannickDraft: keep secret value to avoid multiple sync calls to the keyvaultkeep secret value in PartitionInfo properties to avoid multiple sync calls to the keyvaultkeep secret value in PartitionInfo properties to avoid multiple sync calls to the keyvaulthttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/14Draft: Try sas token2021-06-17T13:55:06ZYannickDraft: Try sas tokenTry sas token to authenticateTry sas token to authenticatehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/13add dask parameters for azure2023-08-17T22:29:17ZYannickadd dask parameters for azureadd dask parameters for azureadd dask parameters for azureM7 - Release 0.10https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/12Fix core version in requirement_opengroup.txt2023-08-17T22:29:19ZYannickFix core version in requirement_opengroup.txtFix core version in requirement_opengroup.txt, use core package 1.0.*Fix core version in requirement_opengroup.txt, use core package 1.0.*M5 - Release 0.8https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/11implement conditional update for concurrency control2023-08-17T22:29:20ZYannickimplement conditional update for concurrency controlimplements concurrent control upon update of wellbore-core-libimplements concurrent control upon update of wellbore-core-libM5 - Release 0.8https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/10Draft: Slb tests dependencies2021-03-31T09:47:16ZLuc YriarteDraft: Slb tests dependencieshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/9Enable unit tests2023-08-17T22:29:22ZLuc YriarteEnable unit testsBring back unit tests from the SLB ADO CICD running a Azurite server.Bring back unit tests from the SLB ADO CICD running a Azurite server.M5 - Release 0.8Luc YriarteLuc Yriartehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/8Draft: Update concurrent2021-03-31T09:32:19ZLuc YriarteDraft: Update concurrenthttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/7Development packages support2023-08-17T22:29:23ZLuc YriarteDevelopment packages supportM4 - Release 0.7Luc YriarteLuc Yriartehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/6Common registry + version bump2023-08-17T22:29:25ZLuc YriarteCommon registry + version bumpM4 - Release 0.7Luc YriarteLuc Yriartehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/5Pull osdu requirements using a separate file2023-08-17T22:29:27ZLuc YriartePull osdu requirements using a separate filePull osdu requirements from internal feed but using a separate file to not mess up the publishing stepPull osdu requirements from internal feed but using a separate file to not mess up the publishing stepM3 - Release 0.5https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/4Slb code push 32023-08-17T22:29:29ZLuc YriarteSlb code push 3M3 - Release 0.5