Open VDS merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests2024-03-22T12:29:04Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/902Fix Emscripten build.2024-03-22T12:29:04ZKim KallandFix Emscripten build.Kim KallandKim Kallandhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/901Merge patches for 3.4.1 release2024-03-21T15:57:16ZMorten OfstadMerge patches for 3.4.1 release* Add CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.
* Improve error reporting for corrupted VDS files in VolumeDataStoreVDSFile.
* Make sure range is initialized in VolumeDataSt...* Add CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.
* Improve error reporting for corrupted VDS files in VolumeDataStoreVDSFile.
* Make sure range is initialized in VolumeDataStoreIOManager::PrepareReadChunkImpl() -- this was causing problems for reading uncompressed VDSs from Azure (and probably other CSPs).
* Fix potential out-of-bounds read in CopyFrom1Bit function, note that this function is not currently used anywhere.
* Limit the format passed to Wavelet_Decompress to be the original format or a quantized version so conversion from integer formats to R32 are handled the same as for other compression methods.
* Add RequestVolumeSubsetIntegerFormatConversionU8/U16 tests.
* Only move from upload/download handler after checking from error in DmsIoManagerFactory. Use the same pattern for extracting response string in all places.
* Disable libidn2 when building Curl since we're going to link statically and we don't want to add extra dependencies. If not disabled, Curl's build system uses check_library_exists to determine if it should be used, but we don't know that we have to add extra libraries to the linker command-line if it does.
* Determine AWS region for bucket with HeadBucket operation (https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html).
* Update README.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/900Add required dependencies when building Curl on MacOS2024-03-22T12:46:24ZMorten OfstadAdd required dependencies when building Curl on MacOSAdd CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.Add CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/899Improve error reporting for corrupted VDS files2024-03-22T12:47:20ZMorten OfstadImprove error reporting for corrupted VDS filesImprove error reporting for corrupted VDS files in VolumeDataStoreVDSFile.Improve error reporting for corrupted VDS files in VolumeDataStoreVDSFile.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/898Fix uninitialized IORange2024-03-22T12:46:03ZMorten OfstadFix uninitialized IORangeMake sure range is initialized in VolumeDataStoreIOManager::PrepareReadChunkImpl() -- this was causing problems for reading uncompressed VDSs from Azure (and probably other CSPs).Make sure range is initialized in VolumeDataStoreIOManager::PrepareReadChunkImpl() -- this was causing problems for reading uncompressed VDSs from Azure (and probably other CSPs).https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/897Fix potential out-of-bounds read in CopyFrom1Bit function2024-03-07T10:01:08ZMorten OfstadFix potential out-of-bounds read in CopyFrom1Bit functionFix potential out-of-bounds read in CopyFrom1Bit function, note that this function is not currently used anywhere.Fix potential out-of-bounds read in CopyFrom1Bit function, note that this function is not currently used anywhere.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/896Fix integer format conversion for Wavlet-compressed data2024-03-07T09:12:54ZMorten OfstadFix integer format conversion for Wavlet-compressed dataLimit the format passed to Wavelet_Decompress to be the original format or a quantized version so conversion from integer formats to R32 are handled the same as for other compression methods.Limit the format passed to Wavelet_Decompress to be the original format or a quantized version so conversion from integer formats to R32 are handled the same as for other compression methods.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/894Avoid using moved-from response to create error message in DmsIoManagerFactory2024-03-01T14:51:09ZMorten OfstadAvoid using moved-from response to create error message in DmsIoManagerFactoryOnly move from upload/download handler after checking from error in DmsIoManagerFactory. Use the same pattern for extracting response string in all places.Only move from upload/download handler after checking from error in DmsIoManagerFactory. Use the same pattern for extracting response string in all places.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/893Disable libidn2 when building Curl2024-02-26T21:31:20ZMorten OfstadDisable libidn2 when building CurlDisable libidn2 when building Curl since we're going to link statically and we don't want to add extra dependencies. If not disabled, Curl's build system uses check_library_exists to determine if it should be used, but we don't know that...Disable libidn2 when building Curl since we're going to link statically and we don't want to add extra dependencies. If not disabled, Curl's build system uses check_library_exists to determine if it should be used, but we don't know that we have to add extra libraries to the linker command-line if it does.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/892Determine AWS region for bucket with HeadBucket operation2024-02-26T21:52:50ZMorten OfstadDetermine AWS region for bucket with HeadBucket operationDetermine AWS region for bucket with HeadBucket operation (https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html).Determine AWS region for bucket with HeadBucket operation (https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html).https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/891Update README2024-02-23T11:24:42ZMorten OfstadUpdate READMEhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/890Fix line-endings issue in patch step for azure-sdk-for-cpp2024-02-21T20:09:48ZMorten OfstadFix line-endings issue in patch step for azure-sdk-for-cpphttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/889Patch the downloaded azure-sdk-for-cpp2024-02-21T20:09:59ZMorten OfstadPatch the downloaded azure-sdk-for-cppPatch the downloaded azure-sdk-for-cpp so it compiles with VS2017.Patch the downloaded azure-sdk-for-cpp so it compiles with VS2017.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/888Patch azure-sdk-for-cpp2024-02-21T15:21:07ZMorten OfstadPatch azure-sdk-for-cppPatch the downloaded azure-sdk-for-cpp so it compiles with VS2017.Patch the downloaded azure-sdk-for-cpp so it compiles with VS2017.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/887Prepare 3.4 release2024-02-20T14:17:00ZMorten OfstadPrepare 3.4 release* Clean up chunking support, fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header.
* Added support for chunked datasets
* Downgrade Abseil to version 20230125.4 which is the last one to...* Clean up chunking support, fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header.
* Added support for chunked datasets
* Downgrade Abseil to version 20230125.4 which is the last one to support VS2017.
* Add OPENSSL_ROOT_DIR to CMAKE_PREFIX_PATH when building curl and aws-crt and make sure to set PKG_CONFIG_USE_CMAKE_PREFIX_PATH=ON when building aws-crt since they forgot to set cmake_minimum_required which means pkg_check_modules in FindOpenSSL would return information for the *system* openssl instead of the one we built.
* Add all available compression information to compression-info from VDSInfo.
* SEGYImport fix for SEGY with descending secondary keys
* Fix missing initialization of new VolumeIndexer in CreateTempBufferIndexer overloads that take an existing VolumeIndexer as a parameter.
* Update ManyLinux to 2_28 since 2_24 is EOL and has too old compilers to work with new versions of abseil.
* Reduce build parallelism for gitlab-ci.
* Do not install link libraries on Linux/MacOS.
* Change order of Abseil libs so they work with single-scan linkers on Linux.
* Set INSTALL_RPATH correctly for MacOS.
* Update openssl and make sure to set libdir when configuring.
* Fix library names for Absl/Crc32c/GCP for Linux/MacOS.
* Move back to alpine:latest after updating the dependencies to versions that compile with GCC 13.
* Include stdint.h where needed. It was pulled in indirectly by string.h prior to GCC 13.
* Specify C++14 standard when building abseil and google cloud libraries. Make the dependencies of google cloud libraries depend on the actual packages built rather than test for platform.
* Update GCP dependencies to latest versions that compile with GCC 13.
* Update GCP to version 1.19.0 and build as external project (with abseil and Crc32c built as separate external projects).
bd30b11e Fix PyGlobal so it doesn't include the constructor for DMSOpenOptions that take a authProviderCallback argument.
* Update Azure SDK for C++ to latest version (1.10.3).
* Allow pip to break system packages in the alpine Dockerfile. Alpine now uses Python 3.11 that implements the new PEP 668, Marking Python base environments as “externally managed”.
* Clean up java CMakeLists and add missing VolumeData.java and WaveletAdaptiveLevel.java files.
* Fix unused variable and catch by value warnings (treated as errors) in RequestVolumeTraces tests.
* Improve SimpleRequestVolumeTraces tests so it takes LOD into account (but still only tests LOD 0 by default). Add new TestLODTracesRequest test based on Julien Lacoste's Java code that reproduced the issue with RequestVolumeTraces when LOD > 0.
* Fix RequestVolumeTraces when LOD > 0.
* Initialize VolumeSampler in InterpolatingVolumeDataAccessor correctly when LOD > 0.
* Use consistent capitalization of LOD.
* Fix resource usage that were moved from
* Fix alpine linux to version 3.18 for the time being until we can update all dependencies.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/886Clean up chunking support2024-02-19T21:30:57ZMorten OfstadClean up chunking support* Clean up chunking support
* Make chunked requests run in parallel
* Fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header
* Some formatting and spelling fixes* Clean up chunking support
* Make chunked requests run in parallel
* Fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header
* Some formatting and spelling fixeshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/885Downgrade Abseil to a version that supports VS20172024-02-16T13:30:20ZMorten OfstadDowngrade Abseil to a version that supports VS2017Downgrade Abseil to version 20230125.4 which is the last one to support VS2017.Downgrade Abseil to version 20230125.4 which is the last one to support VS2017.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/884Find correct OpenSSL when building curl and aws-crt2024-02-16T10:00:36ZMorten OfstadFind correct OpenSSL when building curl and aws-crtAdd OPENSSL_ROOT_DIR to CMAKE_PREFIX_PATH when building curl and aws-crt and make sure to set PKG_CONFIG_USE_CMAKE_PREFIX_PATH=ON when building aws-crt since they forgot to set cmake_minimum_required which means pkg_check_modules in Find...Add OPENSSL_ROOT_DIR to CMAKE_PREFIX_PATH when building curl and aws-crt and make sure to set PKG_CONFIG_USE_CMAKE_PREFIX_PATH=ON when building aws-crt since they forgot to set cmake_minimum_required which means pkg_check_modules in FindOpenSSL would return information for the *system* openssl instead of the one we built.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/883More Compression Info2024-02-26T20:09:54ZMorten OfstadMore Compression InfoAdd all available compression information to compression-info from VDSInfo.Add all available compression information to compression-info from VDSInfo.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/882[34710] added support for chunked datasets2024-02-19T18:42:19ZDeepa Kumari[34710] added support for chunked datasetsFixes Issue: #199
----------------------
Added chunking support for datasetsFixes Issue: #199
----------------------
Added chunking support for datasetsM23 - Release 0.26Deepa KumariDeepa Kumari