seismic-dms-cpp-lib merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests2023-03-07T19:39:33Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/201Merge docs modification2023-03-07T19:39:33ZXiangliang MengMerge docs modificationSquashed commit of the following
commit b7c87eb9
Author: fabien houeto <fhoueto@amazon.com>
Date: Sun Mar 05 2023 12:55:24 GMT-0500 (Eastern Standard Time)
address comment on missing location word
commit 8c8c4124
Author: fhoueto.a...Squashed commit of the following
commit b7c87eb9
Author: fabien houeto <fhoueto@amazon.com>
Date: Sun Mar 05 2023 12:55:24 GMT-0500 (Eastern Standard Time)
address comment on missing location word
commit 8c8c4124
Author: fhoueto.amz <fhoueto@amazon.com>
Date: Tue Feb 28 2023 08:23:43 GMT-0500 (Eastern Standard Time)
Add AWS_REGION environment varaible explanation to readme.Xiangliang MengXiangliang Menghttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/202feat: added md5 checksums for Azure2023-03-16T21:51:55ZGiorgi Baramidzefeat: added md5 checksums for AzurePrevious version of Azure checksums is discarded. New version has only 1 thread and is enabled by default. Customers have to willingly disable it by setting env variablePrevious version of Azure checksums is discarded. New version has only 1 thread and is enabled by default. Customers have to willingly disable it by setting env variableM18 - Release 0.21https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/203fix: fix install cmake2023-05-26T11:38:05ZMark Yanfix: fix install cmakeThe minimum version requirement on cmake should be modified in central cmakelists file.
Roll back the wrong practice.The minimum version requirement on cmake should be modified in central cmakelists file.
Roll back the wrong practice.M17 - Release 0.20https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/204fix: merge from dev to gitlab2023-03-20T19:05:17ZYunhua Koglinfix: merge from dev to gitlabSquashed commit of the following
commit b7c87eb9
Author: fabien houeto <fhoueto@amazon.com>
Date: Sun Mar 05 2023 12:55:24 GMT-0500 (Eastern Standard Time)
address comment on missing location word
commit 8c8c4124
Author: fhoueto.a...Squashed commit of the following
commit b7c87eb9
Author: fabien houeto <fhoueto@amazon.com>
Date: Sun Mar 05 2023 12:55:24 GMT-0500 (Eastern Standard Time)
address comment on missing location word
commit 8c8c4124
Author: fhoueto.amz <fhoueto@amazon.com>
Date: Tue Feb 28 2023 08:23:43 GMT-0500 (Eastern Standard Time)
Add AWS_REGION environment varaible explanation to readme.M17 - Release 0.20Madalyn MarabellaMadalyn Marabellahttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/205feat: customize Azure single upload threshold, chunk size2023-08-18T09:40:19ZArun Manickamfeat: customize Azure single upload threshold, chunk size- Provide flexibility for clients to define Azure Blob single upload threshold and upload chunk size especially for tuning the performance of Azure Blob Storage upload.
- Also ensures that integrity check is done irrespective of single u...- Provide flexibility for clients to define Azure Blob single upload threshold and upload chunk size especially for tuning the performance of Azure Blob Storage upload.
- Also ensures that integrity check is done irrespective of single upload threshold, while downloading (a bug observed in previous MR)
- Minor updates like more comments, renaming appropriately, minimize env variable check.M17 - Release 0.20https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/206docs: added readme for examples2023-03-28T19:37:13ZGiorgi Baramidzedocs: added readme for examplesThe description of all the files located in src/examples are now in readme in same locationThe description of all the files located in src/examples are now in readme in same locationM18 - Release 0.21https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/207fix: update regex2023-04-03T22:26:17ZSumra Zafarfix: update regexhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/208fix: update regex2024-03-07T14:25:18ZSumra Zafarfix: update regexM18 - Release 0.21https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/209fix: use Azure Blob Storage SDK RetryPolicy only to ensure exponential backof...2023-04-20T15:46:22ZArun Manickamfix: use Azure Blob Storage SDK RetryPolicy only to ensure exponential backoff retries## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GC...## Type of change
- [x] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [x] Azure
- [ ] GCP
- [ ] IBM
## Updates description?
> Currently both SDAPI’s retry mechanism (10 retry attempts) and SDK’s default RetryPolicy (3 retry attempts) were intermingled and that resulted in not an exponential backoff retry. This PR is using only SDK’s RetryPolicy for exponential backoff retry, and it has been configured with the same defaults as before (initial delay is 0.5 seconds, max delay is 32 seconds) except for MaxRetry which is now using 30 retry attempts just to replicate the existing behavior (10 * 3 = 30).
Also if token expires during the call to SDK’s BlobClient, SDK will not refresh token automatically ( as SDAPI/SDMS is not using SDK’s mechanism for token authentication and refresh ) and so it has been extracted as refreshTokenRetry to handle that scenario. This probably can happen only if the call has been retrying for quite some time because the expiry of token has been checked before the call was made and there is a margin of 5 mins before expiry.M18 - Release 0.21https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/210feat: add custom retry at SDManager level2023-05-11T16:33:27ZRashaad Grayfeat: add custom retry at SDManager level## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [ ] No
- [X] Yes
## Have you set the target Milestone?
- [ ] No
- [X] Yes
## Have you set the no-detached-pipeline label?
- [ ] No
- [X] Yes
## Updates description?
> This feature allows for the ExponentialRetryBackoffPolicy to be set at the SDManger level instead of only at the dataset levelM18 - Release 0.21Rashaad GrayRashaad Grayhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/211fix: bug that was caused by stoi2023-07-13T14:54:44ZGiorgi Baramidzefix: bug that was caused by stoi## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [X] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [X ] No
- [ ] Yes
## Have you set the target Milestone?
- [X] No
- [ ] Yes
## Have you set the no-detached-pipeline label?
- [] No
- [X] Yes
## Updates description?
There was a bug in parsing the header file. If the number was bigger than ineteger std::stoi would throw exception. So the fix was to change it to std::stull which can handle bigger values.M19 - Release 0.22https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/212fix: build/install on Windows2023-12-09T12:58:20ZPavel Kisliakfix: build/install on Windows## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [] No
- [X] Yes
## Have you set the target Milestone?
- [ ] No
- [X] Yes
## Have you set the no-detached-pipeline label?
- [ ] No
- [X] Yes
## Updates description?
- Fix build on Windows platform on the installation step (hard-coded directories "Debug" and "Release" do not exist).
- Fix path to sources in the Windows build script "\devops\scripts\build-win64.ps1".
Changes from this MR are related only for Windows platform.\
With these fixes, CMake build should correctly work in **single** and **multi-config** modes.
Issue: #18 (reopened)Pavel KisliakPavel Kisliakhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/213fix: inconsistent dll linkage (Windows/VS)2023-12-08T15:18:14ZPavel Kisliakfix: inconsistent dll linkage (Windows/VS)## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [ ] No
- [X] Yes
## Have you set the target Milestone?
- [ ] No
- [X] Yes
## Have you set the no-detached-pipeline label?
- [ ] No
- [X] Yes
## Updates description?
This MR fixes build warnings and linking errors on Windows platform when unit tests are enabled (where uses static library).
- Move definition `BUILDING_DLL` from source files to CMake
- Disable export DLL interfaces for static library version
- Fix warning "_Command line warning D9025: overriding '/W3' with '/W4'_" (reproducible in the CMake single configuration)
Part of issue: #18M22 - Release 0.25Pavel KisliakPavel Kisliakhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/214fix: fixes an issue where logLevel cannot be set programmatically2023-07-13T15:26:01ZJason Wangfix: fixes an issue where logLevel cannot be set programmatically## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [X] No
- [ ] Yes
## Have you set the target Milestone?
- [X] No
- [ ] Yes
## Have you set the no-detached-pipeline label?
- [X] No
- [ ] Yes
## Updates description?
> Update this part with a description of your changesM19 - Release 0.22Jason WangJason Wanghttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/215feat: introduce manifest file for build dependencies via VCPKG manager2023-12-08T15:18:15ZPavel Kisliakfeat: introduce manifest file for build dependencies via VCPKG manager## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [ ] No
- [X] Yes
## Have you set the target Milestone?
- [ ] No
- [X] Yes
## Have you set the no-detached-pipeline label?
- [ ] No
- [X] Yes
## Updates description?
I'd like to introduce support build project with VCPKG manager.
- Introduce VCPKG manifest file
- Make compatible find for GCS libraries (library from VCPKG has different name)
- Add instructions to README.md file how to build on different platforms
- Add "CMakeSettings.json" file for easily open and build project in the Visual Studio
- Comment CMake test project "anthos_storage" (there is no file "anthos_storage.cc" in the repo, which is referenced in CMake)
- Fix error "c101008d Failed to write the updated manifest to the resource of file <...>" on Windows/Release
There are two dependent MRs with fixes for Windows platform, please merge them before this.
I've marked it as "experimental" in the documentation because need to update CI for make all consistent.
Related issue: #16M22 - Release 0.25Pavel KisliakPavel Kisliakhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/216feat: allow turnoff of translate-user-info2023-06-30T15:31:33ZRashaad Grayfeat: allow turnoff of translate-user-info## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [ ] No
- [X] Yes
## Have you set the target Milestone?
- [ ] No
- [X] Yes
## Have you set the no-detached-pipeline label?
- [ ] No
- [X] Yes
## Updates description?
> Add translate-user-info param to dataset_get() && dataset_list()M19 - Release 0.22Rashaad GrayRashaad Grayhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/217fix: remove extra slash '/' from service URL2023-08-29T15:25:54ZRashaad Grayfix: remove extra slash '/' from service URL## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [X] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [ ] No
- [X] Yes
## Have you set the target Milestone?
- [ ] No
- [X] Yes
## Have you set the no-detached-pipeline label?
- [ ] No
- [X] Yes
## Updates description?
> Removes slash '/' from service end of URL if provide to create SDManager instance.M21 - Release 0.24Rashaad GrayRashaad Grayhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/218Draft: feat: enable storage tier option for uploader2023-10-05T05:04:13ZJason WangDraft: feat: enable storage tier option for uploader## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [ ] Bug Fix
- [X] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [ ] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [ ] No
- [X] Yes
## Have you set the target Milestone?
- [ ] No
- [X] Yes
## Have you set the no-detached-pipeline label?
- [ ] No
- [X] Yes
## Updates description?
Enable an optional storage tier when uploading datasets.
The storage tier can be "HOT", or "COOL". if none was provided, Cosmosdb will use default setting for sotrage tier.M21 - Release 0.24https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/219Draft: fix: rename anthos to baremetal2023-10-17T15:41:26ZYan Sushchynski (EPAM)Draft: fix: rename anthos to baremetal## Type of change
- [ ] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ...## Type of change
- [ ] Bug Fix
- [ ] Feature
- [ ] Pipeline
- [ ] Test
## Does this introduce a change in the core logic?
- [X] No
- [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [x] GCP
- [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
- [X ] No
- [ ] Yes
## Have you set the target Milestone?
- [X] No
- [ ] Yes
## Have you set the no-detached-pipeline label?
- [X] No
- [ ] Yes
## Updates description?
> Update this part with a description of your changeshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/220build: updated dependencies in c7 and c7gcc10 build images and added rocky8gcc102023-11-27T16:54:02ZKajal Sawalebuild: updated dependencies in c7 and c7gcc10 build images and added rocky8gcc10## Type of change
* [ ] Bug Fix
* [x] Feature
* [ ] Pipeline
* [ ] Test
## Does this introduce a change in the core logic?
* [x] No
* [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
*...## Type of change
* [ ] Bug Fix
* [x] Feature
* [ ] Pipeline
* [ ] Test
## Does this introduce a change in the core logic?
* [x] No
* [ ] Yes
## Does this introduce a change in the cloud provider implementation, if so which cloud?
* [ ] AWS
* [ ] Azure
* [ ] GCP
* [ ] IBM
## Does this follow [conventional commits spec](https://www.conventionalcommits.org/en/v1.0.0/#summary)?
* [ ] No
* [x] Yes
## Have you set the target Milestone?
* [ ] No
* [x] Yes
## Have you set the no-detached-pipeline label?
* [ ] No
* [x] Yes
## Updates description?
> Upgraded sdapi libraries to the latest versions.M22 - Release 0.25Kajal SawaleKajal Sawale