seismic-dms-cpp-lib merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests2021-11-16T06:54:58Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/108feat: improve error handling2021-11-16T06:54:58ZSid Stenersenfeat: improve error handlingIntroduces a new exception system for the SDAPI.
* Backwards compatible
* Adds detail to exception classes
* Allows future detail additions to existing exception classes
README.md in the sdapi repository has a section on use and migrat...Introduces a new exception system for the SDAPI.
* Backwards compatible
* Adds detail to exception classes
* Allows future detail additions to existing exception classes
README.md in the sdapi repository has a section on use and migration.
34 new exception classes replaces 14 old ones.
The 14 old exception classes are each matched to a specific new exception class, which in turn may have subclasses for finer problem detection.M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/107fix: building Aws and Ibm with 1.8.x series of AwsSdkCpp2021-11-12T14:27:36ZJørgen Lindjorgen.lind@3lc.aifix: building Aws and Ibm with 1.8.x series of AwsSdkCppOpenVDS master branch uses AwsSdkCpp 1.9.x, however the OpenVDS 2.1.x branch uses 1.8.x. We don't want to upgrade it because of some other issues we have not resolved on the master branch yet.OpenVDS master branch uses AwsSdkCpp 1.9.x, however the OpenVDS 2.1.x branch uses 1.8.x. We don't want to upgrade it because of some other issues we have not resolved on the master branch yet.M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/106fix: Add missing assignment to len in AwsStorage::downloadObject2021-11-12T06:17:11ZJørgen Lindjorgen.lind@3lc.aifix: Add missing assignment to len in AwsStorage::downloadObjectM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/105fix: aws and Ibm failing to download objects bigger than 5MB2021-11-11T22:37:13ZJørgen Lindjorgen.lind@3lc.aifix: aws and Ibm failing to download objects bigger than 5MBAlso throw a SDExceptionStorageError if the S3Client can't be created.Also throw a SDExceptionStorageError if the S3Client can't be created.M10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/103fix: Compilation on RedHat 72021-12-13T07:53:15ZJørgen Lindjorgen.lind@3lc.aifix: Compilation on RedHat 7Guard CURLOPT_UPLOAD_BUFFERSIZE with preprocessor checksGuard CURLOPT_UPLOAD_BUFFERSIZE with preprocessor checksM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/101fix: IbmStorage uninitialized memory2021-12-13T07:52:40ZJørgen Lindjorgen.lind@3lc.aifix: IbmStorage uninitialized memoryM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/92build: fix compilation on Windows2021-10-29T09:52:39ZJørgen Lindjorgen.lind@3lc.aibuild: fix compilation on WindowsM10 - Release 0.13https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/117Cherry-pick branch 'jorgen.lind/gcp_empty_chunks' into 'release/0.12'2021-12-09T14:27:22ZDavid Diederichd.diederich@opengroup.orgCherry-pick branch 'jorgen.lind/gcp_empty_chunks' into 'release/0.12'fix: empty chunks not being uploaded correctly with GCP
See merge request osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib!114
(cherry picked from commit 98d59b27b5ac613482076878c6b074400af77d5a)
...fix: empty chunks not being uploaded correctly with GCP
See merge request osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib!114
(cherry picked from commit 98d59b27b5ac613482076878c6b074400af77d5a)
0c456344 fix: empty chunks not being uploaded correctly with GCPM9 - Release 0.12David Diederichd.diederich@opengroup.orgDavid Diederichd.diederich@opengroup.orghttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/100chore: clean up, refactor, reorganize, improve2021-10-22T08:17:34ZSid Stenersenchore: clean up, refactor, reorganize, improve- Add type safety
- Reduce duplicated/redundant code
- Improve spelling/grammar in public API names and internally, for instance
- refreshDatsetMetadata() ==> refreshDatasetMetadata()
- datasetsSize() ==> datasetSizes()
- Remove irre...- Add type safety
- Reduce duplicated/redundant code
- Improve spelling/grammar in public API names and internally, for instance
- refreshDatsetMetadata() ==> refreshDatasetMetadata()
- datasetsSize() ==> datasetSizes()
- Remove irrelevant GCS references, e.g.
- getGcsUrl() ==> getStorageUrl()
- Refactor and reorganize code
- Remove unnecessary polymorphismM9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/99ci: add sanitizer testing2021-09-29T06:42:46ZDaniel Perezci: add sanitizer testingAdding sanitizer testing (ubsan, tsan, asan, lsan)Adding sanitizer testing (ubsan, tsan, asan, lsan)M9 - Release 0.12Daniel PerezDaniel Perezhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/98fix: race conditions2021-09-22T18:04:39ZSid Stenersenfix: race conditionsFix race conditions caused by sdapi logging.
Remove the deprecated msan build mode.Fix race conditions caused by sdapi logging.
Remove the deprecated msan build mode.M9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/97docs: :memo: the main README.md has been reviewed and fixed2021-09-30T18:01:02ZDiego Moltenidocs: :memo: the main README.md has been reviewed and fixedthe main README.md has been reviewed:
- fixed grammar and typos
- fixed the indentation
- updated variable names in the examplesthe main README.md has been reviewed:
- fixed grammar and typos
- fixed the indentation
- updated variable names in the examplesM9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/96build: automate build for ftest, remove redundant coding2021-09-17T07:03:57ZSid Stenersenbuild: automate build for ftest, remove redundant coding- Automates build for new seismic-store targets
- Remove redundant coding for new and existing seismic-store-lib targets- Automates build for new seismic-store targets
- Remove redundant coding for new and existing seismic-store-lib targetsM9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/95fix: ftest/rtest Windows build2021-09-16T14:13:46ZSid Stenersenfix: ftest/rtest Windows buildA [previous MR](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/93) broke the ftest/rtest Windows build. Fix it.A [previous MR](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/93) broke the ftest/rtest Windows build. Fix it.M9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/94fix: azure-curl provider exception type leaks to through core apis to customer!2021-09-22T13:36:17ZAnthony Lichnewskyfix: azure-curl provider exception type leaks to through core apis to customer!built on top of MR !91 that allows upgrade to recent libxml2 fixes the build of experimental providers.
This is a _workaround_.
The correct things to consider doing are :
- make -1LL a constant for Storage::MISSING_OBJECT_SIZE or the ...built on top of MR !91 that allows upgrade to recent libxml2 fixes the build of experimental providers.
This is a _workaround_.
The correct things to consider doing are :
- make -1LL a constant for Storage::MISSING_OBJECT_SIZE or the like
- return that instead of an exception in all providers
- make sure no provider dependent exception type leaks. the customer must not have to write new error handling code when changing cloud provider.
- potentially return stack trace in exception messages...
( current code just sent "Blob does not exist" message. to a call trying to _write_ a new blob... )M9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/93feat: add user-specified HTTP headers to ss svc requests2021-09-15T17:09:35ZSid Stenersenfeat: add user-specified HTTP headers to ss svc requestsAllows the sdapi user to specify HTTP headers to add to seismic store service http requests.Allows the sdapi user to specify HTTP headers to add to seismic store service http requests.M9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/91build: various build fixes ( libxml2 > 2.9.10 ), gcp provider after new logg...2021-09-21T14:34:25ZAnthony Lichnewskybuild: various build fixes ( libxml2 > 2.9.10 ), gcp provider after new logging...various build fixes
- libxml2 > 2.9.10 support
- gcp provider after new logging changes
- gcp storage test with ibm provider turned on
docker images not yet updated accordingly.
tested build with the following updates:
```json
{
"o...various build fixes
- libxml2 > 2.9.10 support
- gcp provider after new logging changes
- gcp storage test with ibm provider turned on
docker images not yet updated accordingly.
tested build with the following updates:
```json
{
"openssl": { "version" : "1.1.1g", "url" : "https://www.openssl.org/" },
"libxml2": { "version" : "2.9.10", "url" : "https://github.com/GNOME/libxml2" },
"azure_sdk_for_cpp": { "version" : "12.0.0", "url" : "https://github.com/Azure/azure-sdk-for-cpp" }
}
```
to
```json
{
"openssl": { "version" : "1.1.1l", "url" : "https://www.openssl.org/" },
"libxml2": { "version" : "2.9.12", "url" : "https://github.com/GNOME/libxml2" },
"azure_sdk_for_cpp": { "version" : "12.1.0", "url" : "https://github.com/Azure/azure-sdk-for-cpp" }
}
```M9 - Release 0.12https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/90Add multi-level logging (AWS)2021-08-25T19:08:50ZSid StenersenAdd multi-level logging (AWS)Adds multi-level logging to AWS storage.
- A header that includes a timestamp is added to each line of output.
- The logging level can be set via the SDAPI_LOGLEVEL environment variable.
- a value of 2 will output everything that wa...Adds multi-level logging to AWS storage.
- A header that includes a timestamp is added to each line of output.
- The logging level can be set via the SDAPI_LOGLEVEL environment variable.
- a value of 2 will output everything that was previously unconditionally written to std::cout
- lower values will output only what should always be output, e.g. error messages.
- the default value is 0
- Each line is now output to the console by a single stream operation. This yields more readable output in multithreaded programs.M8 - Release 0.11https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/89Add multi-level logging (IBM)2021-08-25T13:42:23ZSid StenersenAdd multi-level logging (IBM)Adds multi-level logging to IBM storage.
- A header that includes a timestamp is added to each line of output.
- The logging level can be set via the SDAPI_LOGLEVEL environment variable.
- a value of 2 will output everything that wa...Adds multi-level logging to IBM storage.
- A header that includes a timestamp is added to each line of output.
- The logging level can be set via the SDAPI_LOGLEVEL environment variable.
- a value of 2 will output everything that was previously unconditionally written to std::cout
- lower values will output only what should always be output, e.g. error messages.
- the default value is 0
- Each line is now output to the console by a single stream operation. This yields more readable output in multithreaded programs.M8 - Release 0.11https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/merge_requests/88Add multi-level logging2021-08-20T18:50:36ZSid StenersenAdd multi-level loggingAdd multi-level logging. This allows finer control of what is written to standard output.
The logging level can be set via the SDAPI_LOGLEVEL environment variable.Add multi-level logging. This allows finer control of what is written to standard output.
The logging level can be set via the SDAPI_LOGLEVEL environment variable.M8 - Release 0.11