Wellbore Domain Services merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests2023-08-17T11:20:35Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/311Bug: 500 returned instead of 404 when calling /data with describe2023-08-17T11:20:35Zfabian serinBug: 500 returned instead of 404 when calling /data with describeBefore the fix : in case of describe (read stats) when the blob is not found OSError exception was raised and catched (as Exception) by wdms which is ansewring a 500.
With the fix the OSError is properly catched and a bulknotfound is ret...Before the fix : in case of describe (read stats) when the blob is not found OSError exception was raised and catched (as Exception) by wdms which is ansewring a 500.
With the fix the OSError is properly catched and a bulknotfound is returned (404)M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/309change entity id hash function for local storage2023-08-17T11:20:36ZJeremie Hallalchange entity id hash function for local storagein order to persist bulk data the hash function needs to be changed to give the same result between instances of the servicein order to persist bulk data the hash function needs to be changed to give the same result between instances of the serviceM10 - Release 0.13YannickYannickhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/308module to gather dataframe validation functions2023-08-17T11:20:38ZYannickmodule to gather dataframe validation functionsgather dataframe validation functions + have them stateless without side effects.gather dataframe validation functions + have them stateless without side effects.M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/307Update dask version (vulnerability issue in current version)2023-08-17T11:20:39Zfabian serinUpdate dask version (vulnerability issue in current version)M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/306[bulk storage refactoring]Add module for blob path manipulation2023-08-17T11:20:41ZJeremie Hallal[bulk storage refactoring]Add module for blob path manipulation[Refactoring task] add module for path manipulation of blob files[Refactoring task] add module for path manipulation of blob filesM10 - Release 0.13YannickJeremie HallalVictor DosdaYannickhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/305Extract utils from dask storage2023-08-17T11:20:42ZYannickExtract utils from dask storageCode clean upCode clean upM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/304Update Dockerfile - use latest debain image as base2023-08-17T11:20:44ZVincent RondotUpdate Dockerfile - use latest debain image as baseUse latests debian base image, this should fix a few known vulnerabilities.Use latests debian base image, this should fix a few known vulnerabilities.M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/303Improves the error message and the stack trace in case of error 500 when call...2023-08-17T11:20:45ZChristophe LallementImproves the error message and the stack trace in case of error 500 when calling GET /ddms/v2/trajectories/{trajectoryid}/dataM10 - Release 0.13Christophe LallementChristophe Lallementhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/302Fix - 500 error "[none] not in index" when reading bulk data2023-08-17T11:20:47ZCyril MonmoutonFix - 500 error "[none] not in index" when reading bulk dataM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/301Review bulk uri2023-08-17T11:20:49ZYannickReview bulk uriReview bulk URI to be explicit and centralized management.
Especially, it's used to differentiate storage engine. A meaningless prefix constant usage were found in multiple places in the code with some confusion between bulk id and bulk ...Review bulk URI to be explicit and centralized management.
Especially, it's used to differentiate storage engine. A meaningless prefix constant usage were found in multiple places in the code with some confusion between bulk id and bulk URI making quite hard to follow.
This MR introduce a new class `BulkURI` that encapsulates encode/decoding the URI value. It contains 2 attributes:
- bulkd id
- storage engine version
Storage engine version encapsulates its specific prefix value used in URI value. This prefix is no longer exposed and not meant to be used directly.
Storage engine version on [construction](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/blob/review_bulk_uri/app/bulk_persistence/bulk_uri.py#L72), [check](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/blob/review_bulk_uri/app/bulk_persistence/bulk_uri.py#L72) is made explicit.
Usage examples:
- ctor from URI string value:
`bulk_uri = BulkURI.decode(uri_str)`
- ctor explicit given a bulk_id and a storage version:
`bulk_uri = BulkURI(bulk_id=bulk_id_value, version=BulkStorageVersion_V1)`
- ctor explict using class method:
`bulk_uri = BulkURI.from_bulk_storage_V1(bulk_id_value)`
- encode to URI string value:
`uri_str: str = bulk_uri.encode()`
- check which storage engine version is:
`bulk_uri.storage_version == BulkStorageVersion_V0`
`bulk_uri.is_bulk_storage_V0()`M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/299add missing unit tests2023-08-17T11:20:50ZChristophe Lallementadd missing unit testsM10 - Release 0.13Christophe LallementChristophe Lallementhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/298Updated fossa notice2023-08-17T11:20:52ZLuc YriarteUpdated fossa noticeM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/297fix aws deployment2023-08-17T11:20:53ZYunhua Koglinfix aws deploymentM10 - Release 0.13Yunhua KoglinYunhua Koglinhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/296Update to log get groups test2023-08-17T11:20:55ZVictor DosdaUpdate to log get groups testM10 - Release 0.13Victor DosdaVictor Dosdahttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/295Delete Wellbore DDMS kickoff with R3 team.mp42023-08-17T11:20:56ZVincent RondotDelete Wellbore DDMS kickoff with R3 team.mp4Delete Wellbore DDMS kickoff with R3 team.mp4
(moved to https://community.opengroup.org/osdu/documentation/-/tree/master/platform/api/Wellbore-DDMS/media)Delete Wellbore DDMS kickoff with R3 team.mp4
(moved to https://community.opengroup.org/osdu/documentation/-/tree/master/platform/api/Wellbore-DDMS/media)M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/293Restricted record id kind2023-08-17T11:20:59ZVictor DosdaRestricted record id kindRestricted kindRestricted kindM10 - Release 0.13Victor DosdaVictor Dosdahttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/291initiate filtering capabilities2023-08-17T11:21:00ZJeremie Hallalinitiate filtering capabilitiesM10 - Release 0.13Yuli LiuYuli Liuhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/290fix bug parquet must have string column names2023-08-17T11:21:03ZYuli Liufix bug parquet must have string column namesfix bug parquet must have string column namesfix bug parquet must have string column namesM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/289Fix typo in doc2023-08-17T11:21:05ZVincent RondotFix typo in docM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/288Enable passing of x-user-id header from original request2023-08-17T11:21:06ZRucha DeshpandeEnable passing of x-user-id header from original requestcommit 843bcbf0
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Wed Oct 06 2021 14:36:11 GMT-0500 (Central Daylight Time)
Fixing problem in package
commit 64ee6532
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Wed Oct...commit 843bcbf0
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Wed Oct 06 2021 14:36:11 GMT-0500 (Central Daylight Time)
Fixing problem in package
commit 64ee6532
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Wed Oct 06 2021 12:54:14 GMT-0500 (Central Daylight Time)
Fixing int tests
commit 52583f64
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Tue Oct 05 2021 16:40:51 GMT-0500 (Central Daylight Time)
Changing int tests to run on osdu for multi-tenant
commit e468bd98
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Tue Oct 05 2021 15:20:32 GMT-0500 (Central Daylight Time)
Adding python sdk
commit 7f9b51c3
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Tue Oct 05 2021 15:12:52 GMT-0500 (Central Daylight Time)
Trying another version of package
commit ad5fe185
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Tue Oct 05 2021 13:39:05 GMT-0500 (Central Daylight Time)
Testing with new wellbore aws artifact
commit e4b96cb5
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Mon Oct 04 2021 11:57:34 GMT-0500 (Central Daylight Time)
Incrmenting dev pkg
commit 62476a73
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Mon Oct 04 2021 10:52:56 GMT-0500 (Central Daylight Time)
Switching to later gl artifact
commit a2e67372
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Mon Oct 04 2021 09:19:02 GMT-0500 (Central Daylight Time)
Fixing build
commit ff06b2d6
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Mon Oct 04 2021 09:04:23 GMT-0500 (Central Daylight Time)
Trying to switch to new dev pkg
commit 4a695e91
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Fri Oct 01 2021 12:42:01 GMT-0500 (Central Daylight Time)
Updating aws package name
commit 46117cc7
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Fri Oct 01 2021 09:12:28 GMT-0500 (Central Daylight Time)
Fixing to right version of aws core lib
commit f7215f0e
Author: Spencer Sutton <suttonsp@amazon.com>
Date: Thu Sep 30 2021 13:32:41 GMT-0500 (Central Daylight Time)
Using lib with multi-tenantM10 - Release 0.13Rucha DeshpandeGregBill WangYunhua KoglinRucha Deshpande