Open VDS merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests2023-04-19T07:29:26Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/802Adding Buildspec changes2023-04-19T07:29:26ZAbhay JoshiAdding Buildspec changescommit 9379f259
Author: Morris Estepa <estepamo@amazon.com>
Date: Thu Sep 08 2022 16:37:45 GMT-0500 (Central Daylight Time)
add git secretscommit 9379f259
Author: Morris Estepa <estepamo@amazon.com>
Date: Thu Sep 08 2022 16:37:45 GMT-0500 (Central Daylight Time)
add git secretsM18 - Release 0.21Okoun-Ola Fabien HouetoAbhay JoshiOkoun-Ola Fabien Houetohttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/843Fetch legal tag from Segy file and use it for VDS Creation2023-08-28T07:48:27ZDeepa KumariFetch legal tag from Segy file and use it for VDS CreationAs described in issue: https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/issues/16
The VDS File creation fails, when the parent repository is not having a legal tag even though the Segy File is h...As described in issue: https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/issues/16
The VDS File creation fails, when the parent repository is not having a legal tag even though the Segy File is having a legal tag.
Changes made to resolve the issue:
1. Read the legal while the attempt to lock the Segy File is made. It will be the ltag which is returned from the Seismic Store Lock API
2. Fetch this Legal tag from Segy Import file by iterating over all data providers before VDS Creation
3. Add this legal tag to connection string(if present)
4. Legal tag will be then processed and converted into DMSOptions, when VDS create is called.
5. Legal tag from DMS Options will then be used when attempt to Register dataset is made.
6. In all the cases, wherever noticed added a warning to tell Legal tag is empty.M20 - Release 0.23Deepa KumariDeepa Kumarihttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/841AWS sync dev to master2023-08-24T11:10:04ZGuillaume CailletAWS sync dev to masterM20 - Release 0.23Guillaume CailletGuillaume Caillethttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/859Return the variable back (GONRG-7814)2023-10-10T11:13:26ZAndrei Skorkin [EPAM / GCP]Return the variable back (GONRG-7814)Based on comment https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/issues/214#note_254702, I have returned the definition of the `INGESTION_DOCKER_WITH_PYTHON_IMAGE_TAG` variable.Based on comment https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/issues/214#note_254702, I have returned the definition of the `INGESTION_DOCKER_WITH_PYTHON_IMAGE_TAG` variable.M21 - Release 0.24Andrei Skorkin [EPAM / GCP]Andrei Skorkin [EPAM / GCP]https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/872Update buildspec.yaml2023-11-30T20:56:34ZYunhua KoglinUpdate buildspec.yamlM22 - Release 0.25Yunhua KoglinYunhua Koglinhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/882[34710] added support for chunked datasets2024-02-19T18:42:19ZDeepa Kumari[34710] added support for chunked datasetsFixes Issue: #199
----------------------
Added chunking support for datasetsFixes Issue: #199
----------------------
Added chunking support for datasetsM23 - Release 0.26Deepa KumariDeepa Kumarihttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/877[MSCOSDU-2089] fix resource usage that were moved from2024-02-28T12:42:23ZDeepa Kumari[MSCOSDU-2089] fix resource usage that were moved fromFix for #225Fix for #225M23 - Release 0.26Deepa KumariDeepa Kumarihttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/902Fix Emscripten build.2024-03-22T12:29:04ZKim KallandFix Emscripten build.Kim KallandKim Kallandhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/901Merge patches for 3.4.1 release2024-03-21T15:57:16ZMorten OfstadMerge patches for 3.4.1 release* Add CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.
* Improve error reporting for corrupted VDS files in VolumeDataStoreVDSFile.
* Make sure range is initialized in VolumeDataSt...* Add CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.
* Improve error reporting for corrupted VDS files in VolumeDataStoreVDSFile.
* Make sure range is initialized in VolumeDataStoreIOManager::PrepareReadChunkImpl() -- this was causing problems for reading uncompressed VDSs from Azure (and probably other CSPs).
* Fix potential out-of-bounds read in CopyFrom1Bit function, note that this function is not currently used anywhere.
* Limit the format passed to Wavelet_Decompress to be the original format or a quantized version so conversion from integer formats to R32 are handled the same as for other compression methods.
* Add RequestVolumeSubsetIntegerFormatConversionU8/U16 tests.
* Only move from upload/download handler after checking from error in DmsIoManagerFactory. Use the same pattern for extracting response string in all places.
* Disable libidn2 when building Curl since we're going to link statically and we don't want to add extra dependencies. If not disabled, Curl's build system uses check_library_exists to determine if it should be used, but we don't know that we have to add extra libraries to the linker command-line if it does.
* Determine AWS region for bucket with HeadBucket operation (https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html).
* Update README.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/900Add required dependencies when building Curl on MacOS2024-03-22T12:46:24ZMorten OfstadAdd required dependencies when building Curl on MacOSAdd CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.Add CoreFoundation and SystemConfiguration frameworks as dependencies for MacOS when building Curl ourselves.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/899Improve error reporting for corrupted VDS files2024-03-22T12:47:20ZMorten OfstadImprove error reporting for corrupted VDS filesImprove error reporting for corrupted VDS files in VolumeDataStoreVDSFile.Improve error reporting for corrupted VDS files in VolumeDataStoreVDSFile.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/898Fix uninitialized IORange2024-03-22T12:46:03ZMorten OfstadFix uninitialized IORangeMake sure range is initialized in VolumeDataStoreIOManager::PrepareReadChunkImpl() -- this was causing problems for reading uncompressed VDSs from Azure (and probably other CSPs).Make sure range is initialized in VolumeDataStoreIOManager::PrepareReadChunkImpl() -- this was causing problems for reading uncompressed VDSs from Azure (and probably other CSPs).https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/897Fix potential out-of-bounds read in CopyFrom1Bit function2024-03-07T10:01:08ZMorten OfstadFix potential out-of-bounds read in CopyFrom1Bit functionFix potential out-of-bounds read in CopyFrom1Bit function, note that this function is not currently used anywhere.Fix potential out-of-bounds read in CopyFrom1Bit function, note that this function is not currently used anywhere.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/896Fix integer format conversion for Wavlet-compressed data2024-03-07T09:12:54ZMorten OfstadFix integer format conversion for Wavlet-compressed dataLimit the format passed to Wavelet_Decompress to be the original format or a quantized version so conversion from integer formats to R32 are handled the same as for other compression methods.Limit the format passed to Wavelet_Decompress to be the original format or a quantized version so conversion from integer formats to R32 are handled the same as for other compression methods.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/895Fix CRS problem when the data is displayed in different UTM zones at the same...2024-03-01T14:50:11ZMartin DuongFix CRS problem when the data is displayed in different UTM zones at the same project.LATTICE_ORIGIN/LATTICE_INLINE_SPACING/LATTICE_CROSSLINE_SPACING use as display survey.
while LATTICE_*_ORIGINAL (e.g UTM 21S) use for CRS transform to update LATTICE_ORIGIN/LATTICE_INLINE_SPACING/LATTICE_CROSSLINE_SPACING (e.g UTM 20S)
...LATTICE_ORIGIN/LATTICE_INLINE_SPACING/LATTICE_CROSSLINE_SPACING use as display survey.
while LATTICE_*_ORIGINAL (e.g UTM 21S) use for CRS transform to update LATTICE_ORIGIN/LATTICE_INLINE_SPACING/LATTICE_CROSSLINE_SPACING (e.g UTM 20S)
missing LATTICE_*_ORIGINAL cause incorrect CRS transform.Martin DuongMartin Duonghttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/894Avoid using moved-from response to create error message in DmsIoManagerFactory2024-03-01T14:51:09ZMorten OfstadAvoid using moved-from response to create error message in DmsIoManagerFactoryOnly move from upload/download handler after checking from error in DmsIoManagerFactory. Use the same pattern for extracting response string in all places.Only move from upload/download handler after checking from error in DmsIoManagerFactory. Use the same pattern for extracting response string in all places.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/893Disable libidn2 when building Curl2024-02-26T21:31:20ZMorten OfstadDisable libidn2 when building CurlDisable libidn2 when building Curl since we're going to link statically and we don't want to add extra dependencies. If not disabled, Curl's build system uses check_library_exists to determine if it should be used, but we don't know that...Disable libidn2 when building Curl since we're going to link statically and we don't want to add extra dependencies. If not disabled, Curl's build system uses check_library_exists to determine if it should be used, but we don't know that we have to add extra libraries to the linker command-line if it does.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/892Determine AWS region for bucket with HeadBucket operation2024-02-26T21:52:50ZMorten OfstadDetermine AWS region for bucket with HeadBucket operationDetermine AWS region for bucket with HeadBucket operation (https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html).Determine AWS region for bucket with HeadBucket operation (https://docs.aws.amazon.com/AmazonS3/latest/API/API_HeadBucket.html).https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/891Update README2024-02-23T11:24:42ZMorten OfstadUpdate READMEhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/890Fix line-endings issue in patch step for azure-sdk-for-cpp2024-02-21T20:09:48ZMorten OfstadFix line-endings issue in patch step for azure-sdk-for-cpp