Open VDS merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests2024-02-21T20:09:48Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/890Fix line-endings issue in patch step for azure-sdk-for-cpp2024-02-21T20:09:48ZMorten OfstadFix line-endings issue in patch step for azure-sdk-for-cpphttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/889Patch the downloaded azure-sdk-for-cpp2024-02-21T20:09:59ZMorten OfstadPatch the downloaded azure-sdk-for-cppPatch the downloaded azure-sdk-for-cpp so it compiles with VS2017.Patch the downloaded azure-sdk-for-cpp so it compiles with VS2017.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/888Patch azure-sdk-for-cpp2024-02-21T15:21:07ZMorten OfstadPatch azure-sdk-for-cppPatch the downloaded azure-sdk-for-cpp so it compiles with VS2017.Patch the downloaded azure-sdk-for-cpp so it compiles with VS2017.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/887Prepare 3.4 release2024-02-20T14:17:00ZMorten OfstadPrepare 3.4 release* Clean up chunking support, fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header.
* Added support for chunked datasets
* Downgrade Abseil to version 20230125.4 which is the last one to...* Clean up chunking support, fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header.
* Added support for chunked datasets
* Downgrade Abseil to version 20230125.4 which is the last one to support VS2017.
* Add OPENSSL_ROOT_DIR to CMAKE_PREFIX_PATH when building curl and aws-crt and make sure to set PKG_CONFIG_USE_CMAKE_PREFIX_PATH=ON when building aws-crt since they forgot to set cmake_minimum_required which means pkg_check_modules in FindOpenSSL would return information for the *system* openssl instead of the one we built.
* Add all available compression information to compression-info from VDSInfo.
* SEGYImport fix for SEGY with descending secondary keys
* Fix missing initialization of new VolumeIndexer in CreateTempBufferIndexer overloads that take an existing VolumeIndexer as a parameter.
* Update ManyLinux to 2_28 since 2_24 is EOL and has too old compilers to work with new versions of abseil.
* Reduce build parallelism for gitlab-ci.
* Do not install link libraries on Linux/MacOS.
* Change order of Abseil libs so they work with single-scan linkers on Linux.
* Set INSTALL_RPATH correctly for MacOS.
* Update openssl and make sure to set libdir when configuring.
* Fix library names for Absl/Crc32c/GCP for Linux/MacOS.
* Move back to alpine:latest after updating the dependencies to versions that compile with GCC 13.
* Include stdint.h where needed. It was pulled in indirectly by string.h prior to GCC 13.
* Specify C++14 standard when building abseil and google cloud libraries. Make the dependencies of google cloud libraries depend on the actual packages built rather than test for platform.
* Update GCP dependencies to latest versions that compile with GCC 13.
* Update GCP to version 1.19.0 and build as external project (with abseil and Crc32c built as separate external projects).
bd30b11e Fix PyGlobal so it doesn't include the constructor for DMSOpenOptions that take a authProviderCallback argument.
* Update Azure SDK for C++ to latest version (1.10.3).
* Allow pip to break system packages in the alpine Dockerfile. Alpine now uses Python 3.11 that implements the new PEP 668, Marking Python base environments as “externally managed”.
* Clean up java CMakeLists and add missing VolumeData.java and WaveletAdaptiveLevel.java files.
* Fix unused variable and catch by value warnings (treated as errors) in RequestVolumeTraces tests.
* Improve SimpleRequestVolumeTraces tests so it takes LOD into account (but still only tests LOD 0 by default). Add new TestLODTracesRequest test based on Julien Lacoste's Java code that reproduced the issue with RequestVolumeTraces when LOD > 0.
* Fix RequestVolumeTraces when LOD > 0.
* Initialize VolumeSampler in InterpolatingVolumeDataAccessor correctly when LOD > 0.
* Use consistent capitalization of LOD.
* Fix resource usage that were moved from
* Fix alpine linux to version 3.18 for the time being until we can update all dependencies.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/886Clean up chunking support2024-02-19T21:30:57ZMorten OfstadClean up chunking support* Clean up chunking support
* Make chunked requests run in parallel
* Fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header
* Some formatting and spelling fixes* Clean up chunking support
* Make chunked requests run in parallel
* Fix all IOManagers so they all use exclusive IORanges and subtract 1 when creating the range HTTP header
* Some formatting and spelling fixeshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/885Downgrade Abseil to a version that supports VS20172024-02-16T13:30:20ZMorten OfstadDowngrade Abseil to a version that supports VS2017Downgrade Abseil to version 20230125.4 which is the last one to support VS2017.Downgrade Abseil to version 20230125.4 which is the last one to support VS2017.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/884Find correct OpenSSL when building curl and aws-crt2024-02-16T10:00:36ZMorten OfstadFind correct OpenSSL when building curl and aws-crtAdd OPENSSL_ROOT_DIR to CMAKE_PREFIX_PATH when building curl and aws-crt and make sure to set PKG_CONFIG_USE_CMAKE_PREFIX_PATH=ON when building aws-crt since they forgot to set cmake_minimum_required which means pkg_check_modules in Find...Add OPENSSL_ROOT_DIR to CMAKE_PREFIX_PATH when building curl and aws-crt and make sure to set PKG_CONFIG_USE_CMAKE_PREFIX_PATH=ON when building aws-crt since they forgot to set cmake_minimum_required which means pkg_check_modules in FindOpenSSL would return information for the *system* openssl instead of the one we built.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/883More Compression Info2024-02-26T20:09:54ZMorten OfstadMore Compression InfoAdd all available compression information to compression-info from VDSInfo.Add all available compression information to compression-info from VDSInfo.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/881SEGYImport fix for SEGY with descending secondary keys2024-02-02T19:30:34ZJim KingSEGYImport fix for SEGY with descending secondary keysSEGYImport was not able to import SEGY with descending secondary key values.SEGYImport was not able to import SEGY with descending secondary key values.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/880Add missing VolumeData and WaveletAdaptiveLevel classes to Java API2024-02-26T20:07:38ZMorten OfstadAdd missing VolumeData and WaveletAdaptiveLevel classes to Java APIhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/879Fix LOD issues with RequestVolumeTraces and InterpolatingVolumeDataAccessor2024-01-31T14:26:38ZMorten OfstadFix LOD issues with RequestVolumeTraces and InterpolatingVolumeDataAccessor* Improve SimpleRequestVolumeTraces tests so it takes LOD into account (but still only tests LOD 0 by default). Add new TestLODTracesRequest test based on Julien Lacoste's Java code that reproduced the issue with RequestVolumeTraces when...* Improve SimpleRequestVolumeTraces tests so it takes LOD into account (but still only tests LOD 0 by default). Add new TestLODTracesRequest test based on Julien Lacoste's Java code that reproduced the issue with RequestVolumeTraces when LOD > 0.
* Fix RequestVolumeTraces when LOD > 0.
* Initialize VolumeSampler in InterpolatingVolumeDataAccessor correctly when LOD > 0.
* Use consistent capitalization of LOD.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/878Update all dependencies to versions that work with GCC 132024-02-01T07:12:01ZMorten OfstadUpdate all dependencies to versions that work with GCC 13* Update ManyLinux to 2_28 since 2_24 is EOL and has too old compilers to work with new versions of abseil.
* Reduce build parallelism for gitlab-ci.
* Do not install link libraries on Linux/MacOS.
* Change order of Abseil libs so they w...* Update ManyLinux to 2_28 since 2_24 is EOL and has too old compilers to work with new versions of abseil.
* Reduce build parallelism for gitlab-ci.
* Do not install link libraries on Linux/MacOS.
* Change order of Abseil libs so they work with single-scan linkers on Linux.
* Set INSTALL_RPATH correctly for MacOS.
* Update openssl and make sure to set libdir when configuring.
* Fix library names for Absl/Crc32c/GCP for Linux/MacOS.
* Include stdint.h where needed. It was pulled in indirectly by string.h prior to GCC 13.
* Specify C++14 standard when building abseil and google cloud libraries. Make the dependencies of google cloud libraries depend on the actual packages built rather than test for platform.
* Update GCP dependencies to latest versions that compile with GCC 13.
* Update GCP to version 1.19.0 and build as external project (with abseil and Crc32c built as separate external projects).
* Fix PyGlobal so it doesn't include the constructor for DMSOpenOptions that take a authProviderCallback argument.
* Update Azure SDK for C++ to latest version (1.10.3).
* Allow pip to break system packages in the alpine Dockerfile. Alpine now uses Python 3.11 that implements the new PEP 668, Marking Python base environments as “externally managed”.Morten OfstadMorten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/875Next development release is 3.52024-01-26T12:52:16ZMorten OfstadNext development release is 3.5https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/874Add specific dependencies for Ubuntu 22.04 and provide build example.2024-02-20T12:56:00ZJonathan WatmoughAdd specific dependencies for Ubuntu 22.04 and provide build example.* Adds description of required dependencies from a regular desktop install of Ubuntu 22.04 LTS
* Adds suggestion to use `mold` linker
* Avoids OOM errors when building OpenVDS with `ld`
* Significantly reduces time required to link
*...* Adds description of required dependencies from a regular desktop install of Ubuntu 22.04 LTS
* Adds suggestion to use `mold` linker
* Avoids OOM errors when building OpenVDS with `ld`
* Significantly reduces time required to link
* One line fix to code, can be taken out if needed, but removes a dead-store identified with `clang-tidy`Morten OfstadJonathan WatmoughMorten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/873Fix missing decoding of escaped characters in VDSObjectParser2023-12-01T16:46:25ZMorten OfstadFix missing decoding of escaped characters in VDSObjectParserUnescape escaped characters in extractStringVal function in VDSObjectParser. Simplified logic a little in getNextToken() where it handles quoted strings (no change in behaviour).Unescape escaped characters in extractStringVal function in VDSObjectParser. Simplified logic a little in getNextToken() where it handles quoted strings (no change in behaviour).https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/871Improved parameter validation2023-11-30T14:05:58ZMorten OfstadImproved parameter validationImproved parameter validation of dimension parameter for methods on the VolumeDataLayout so it is consistent with commercial VDS implementation.Improved parameter validation of dimension parameter for methods on the VolumeDataLayout so it is consistent with commercial VDS implementation.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/870Add APIs to query the compressed/uncompressed size and available adaptive lev...2023-11-30T13:29:00ZMorten OfstadAdd APIs to query the compressed/uncompressed size and available adaptive levels for a wavelet compressed VDSAdded APIs to query the compressed/uncompressed size and available adaptive levels for a wavelet compressed VDS.Added APIs to query the compressed/uncompressed size and available adaptive levels for a wavelet compressed VDS.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/869Make the source tree pip installable2023-11-24T16:29:47ZMorten OfstadMake the source tree pip installableDon't use HINTS to specify python path, it only works if there is a cmake file there. Add numpy to requirements in pyproject.toml since we use the headers during compilation.Don't use HINTS to specify python path, it only works if there is a cmake file there. Add numpy to requirements in pyproject.toml since we use the headers during compilation.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/868Add HTTP proxy support for the Seismic DMS service2023-11-24T10:30:24ZMorten OfstadAdd HTTP proxy support for the Seismic DMS service- Added new option for setting HTTP proxy for the DMS service to the DMSOpenOptions.
- Output Java and Python bindings for DMSOpenOptions with httpProxy.- Added new option for setting HTTP proxy for the DMS service to the DMSOpenOptions.
- Output Java and Python bindings for DMSOpenOptions with httpProxy.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/867Link to VDS use-cases from README.md2023-11-02T17:27:22ZMorten OfstadLink to VDS use-cases from README.md