Open VDS merge requestshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests2020-10-13T20:03:32Zhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/253Update README.md to fix some misspellings, grammar, capitalization2020-10-13T20:03:32ZKelly WalkerUpdate README.md to fix some misspellings, grammar, capitalizationhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/252Fix: "Connection URL and Connection String" documentation look for GCP connec...2020-10-08T12:41:48ZDzmitry Poloyko (EPAM)Fix: "Connection URL and Connection String" documentation look for GCP connection string (GONRG-828)Fix GS connection string sample section look.
## Type of change
- [X ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which ...Fix GS connection string sample section look.
## Type of change
- [X ] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
GS connection string sample section looks improperly.
## What is the new/expected behavior?
Connection string sample section has the same format as for AWS and Azure.
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Changes:
- "Connection URL and Connection String" documentation was updated in order to GS connection string sample section has the same format as for AWS and Azure.
## Notes:
The sample token is dummy and doesn't grant access to any resource.Jørgen Lindjorgen.lind@3lc.aiDzmitry Poloyko (EPAM)Jørgen Lindjorgen.lind@3lc.aihttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/251Pass OAuth2 token as the connection string parameter for Google Storage (GONR...2020-10-08T09:32:36ZDzmitry Poloyko (EPAM)Pass OAuth2 token as the connection string parameter for Google Storage (GONRG-828)Adds ability to pass OAuth2 token as the connection string parameter for Google Cloud Storage
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in ...Adds ability to pass OAuth2 token as the connection string parameter for Google Cloud Storage
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
There is no way to pass OAuth2 token as the parameter for SEGYUtils commandline
## What is the new/expected behavior?
OAuth2 can be passed via Connection String
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Changes:
- GoogleOpenOptions creation was extended;
- "Connection URL and Connection String" documentation was updated respectively.
## Notes:
The sample token is dummy and doesn't grant access to any resource.Morten OfstadJørgen Lindjorgen.lind@3lc.aiDzmitry Poloyko (EPAM)Morten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/250Remove the pendingDownload from the list after it has finished2020-10-07T13:57:00ZJørgen Lindjorgen.lind@3lc.aiRemove the pendingDownload from the list after it has finishedThis increases the chance of chunks not being downloaded twiceThis increases the chance of chunks not being downloaded twicehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/249Feature/jorgen.lind/bug fixes2020-10-06T12:26:30ZJørgen Lindjorgen.lind@3lc.aiFeature/jorgen.lind/bug fixeshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/248Rename Java OpenVDS.cpp to OpenVDSJava.cpp2020-10-05T09:37:00ZJørgen Lindjorgen.lind@3lc.aiRename Java OpenVDS.cpp to OpenVDSJava.cppAlso remove unused pro fileAlso remove unused pro filehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/247Add Non SSE uint wavelet decompression2020-10-01T09:27:12ZJørgen Lindjorgen.lind@3lc.aiAdd Non SSE uint wavelet decompressionhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/246Fix build of crc32c on CentOS 72020-09-30T12:39:28ZJørgen Lindjorgen.lind@3lc.aiFix build of crc32c on CentOS 7https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/245+Update documentation with new help command line arguments2020-09-30T09:16:34ZJørgen Lindjorgen.lind@3lc.ai+Update documentation with new help command line argumentshttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/244Fix BuildExternal script to be able build static libraries without archives (...2020-09-30T08:26:58ZDzmitry Poloyko (EPAM)Fix BuildExternal script to be able build static libraries without archives (.a) into binary output and use it for crc32c. (GONRG-402)Fix for BuildExternal script to be able build static libraries without archives (.a) into binary output.
## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a...Fix for BuildExternal script to be able build static libraries without archives (.a) into binary output.
## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [X] AWS
- [X] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Crc32c is created as a static library and unnecessary .a file is placed to binary output
## What is the new/expected behavior?
Crc32c is created as a static library without distributing of .a file
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Changes:
- BuildExternal build script is updated.
- The build scripts for shared libraries and OpenVDS is updated.Morten OfstadJørgen Lindjorgen.lind@3lc.aiDzmitry Poloyko (EPAM)Morten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/243Jupyter Notebook section on Python path2020-09-29T12:01:30ZJørgen Lindjorgen.lind@3lc.aiJupyter Notebook section on Python pathhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/242Feature/jorgen.lind/tools fixup2020-09-28T14:05:06ZJørgen Lindjorgen.lind@3lc.aiFeature/jorgen.lind/tools fixuphttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/241Feature/jorgen.lind/waveletinteger2020-09-24T12:39:04ZJørgen Lindjorgen.lind@3lc.aiFeature/jorgen.lind/waveletintegerhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/240Build crc32c as a shared library (GONRG-400)2020-09-25T09:56:11ZDzmitry Poloyko (EPAM)Build crc32c as a shared library (GONRG-400)Build crc32c as a shared library
## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] A...Build crc32c as a shared library
## Type of change
- [X] Bug Fix
- [ ] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Crc32c is created as a static library and unnecessary .a file is placed to binary output
## What is the new/expected behavior?
Crc32c is created as a shared(dll) library without distributing of .a file
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Changes:
CMake build script for crc32c is updated.Morten OfstadJørgen Lindjorgen.lind@3lc.aiDzmitry Poloyko (EPAM)Morten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/239Option to access Google Cloud via signed URLs (GONRG-61)2020-09-21T07:21:47ZDzmitry Poloyko (EPAM)Option to access Google Cloud via signed URLs (GONRG-61)Adds experimental ability to authenticate to Google Cloud using Signed URLs V4 instead of OAuth token
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a ch...Adds experimental ability to authenticate to Google Cloud using Signed URLs V4 instead of OAuth token
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
OAuth2 token are used to work with Google Cloud
## What is the new/expected behavior?
Both mechanisms: OAuth2 token and Signed URLs can be selecyed viaGoogleOpenOptions
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Changes:
- GoogleOpenOptions structure has been extended to handle Signed URLs;
- IOManagerGoogle has been extended respectively;
- Python wrappers were updated.Morten OfstadJørgen Lindjorgen.lind@3lc.aiDzmitry Poloyko (EPAM)Morten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/238Specify the storage class in options (GONRG-498)2020-09-15T15:54:27ZDzmitry Poloyko (EPAM)Specify the storage class in options (GONRG-498)Adds ability to pass Coogle Cloud credentials via OpenVDS options
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implement...Adds ability to pass Coogle Cloud credentials via OpenVDS options
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
There is no way to specify storage class while uploading
## What is the new/expected behavior?
Stroage class can be set into GoogleOpenOptions structure
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Changes:
- GoogleOpenOptions structure has been extended to handle Stroage class;
- IOManagerGoogle has been extended respectively;
- Python wrappers were updated.Morten OfstadJørgen Lindjorgen.lind@3lc.aiDzmitry Poloyko (EPAM)Morten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/237Default arguments for AWSOpenOptions in Python2020-09-14T18:14:27ZMorten OfstadDefault arguments for AWSOpenOptions in PythonFix #53.Fix #53.https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/236Update pybind11 code to disallow None everywhere2020-09-14T12:28:02ZMorten OfstadUpdate pybind11 code to disallow None everywherehttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/235Pass Coogle Cloud credentials via options (GONRG-397)2020-09-14T19:34:13ZDzmitry Poloyko (EPAM)Pass Coogle Cloud credentials via options (GONRG-397)Adds ability to pass Coogle Cloud credentials via OpenVDS options
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implement...Adds ability to pass Coogle Cloud credentials via OpenVDS options
## Type of change
- [ ] Bug Fix
- [X] Feature
## Does this introduce a change in the core logic?
- [NO]
## Does this introduce a change in the cloud provider implementation, if so which cloud?
- [ ] AWS
- [ ] Azure
- [X] GCP
- [ ] IBM
## Does this introduce a breaking change?
- [NO]
## What is the current behavior?
Credentials can be provided only via ADC (GOOGLE_APPLICATION_CREDENTIALS environment variable)
## What is the new/expected behavior?
Credentials can be passed to GoogleOpenOptions structure
## Have you added/updated Unit Tests and Integration Tests?
- [NO]
## Changes:
- GoogleOpenOptions structure has been extended to handle credentials;
- IOManagerGoogle has been extended respectively.Morten OfstadJørgen Lindjorgen.lind@3lc.aiDzmitry Poloyko (EPAM)Morten Ofstadhttps://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/open-vds/-/merge_requests/234Update Python Metadata API2020-09-11T14:43:40ZMorten OfstadUpdate Python Metadata APIUpdated the Python API autogeneration system so it works with the Metadata.h header being split into MetadataKey.h, MetadataAccess.h and MetadataContainer.h. Reran autogeneration and fixed missing implementations. Updated the Python crea...Updated the Python API autogeneration system so it works with the Metadata.h header being split into MetadataKey.h, MetadataAccess.h and MetadataContainer.h. Reran autogeneration and fixed missing implementations. Updated the Python createtest so it uses KnownMetadata to set the origin of the VDS it creates.