Major performance work, adding GSM logging module and created authentication plugin framework module.
Type of change
-
Bug Fix - [x ] Feature
Does this introduce a change in the core logic?
- [Yes]
Does this introduce a change in the cloud provider implementation, if so which cloud?
-
AWS -
Azure -
GCP -
IBM
Updates description?
- Change to DAG: The environment SD_READ_CACHE_MAX_PAGES now controls number of 40MB (average value) pages of read-ahead buffers to be used. Please make sure this value is set to a reasonable value, usually a value between 16 and 64 should work, but might cause the DAG to run out of memory if set too large.
- Authentication plugin framework allows for integrating into more sophisticated authentication scheme than simply providing a JWT token, e.g. support for oauth2.
- Major rework of data access when running the SEG-Y to ZGY converter from cloud based repository