... | ... | @@ -47,6 +47,12 @@ No in-place schema changes are required in M15 (no M14 schema resources were cha |
|
|
* The content of TubularAssemblyType was by accident replicated in TubularAssenblyStatusType. The content has been corrected for [TubularAssemblyStatusType:1.0.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.18.1/E-R/reference-data/TubularAssemblyStatusType.1.0.0.md).
|
|
|
|
|
|
### Core and Helper Services
|
|
|
- `File Service`
|
|
|
- `AWS` - Now the file checksum is added to the metadata. See [ADR](https://community.opengroup.org/osdu/platform/system/file/-/issues/64)
|
|
|
|
|
|
### Ingestion services
|
|
|
- Manifest-based Ingestion - Manifest by reference.
|
|
|
- `AWS` now support ingestion of manifest by reference.
|
|
|
|
|
|
### DDMS
|
|
|
|
... | ... | @@ -147,11 +153,9 @@ No in-place schema changes are required in M15 (no M14 schema resources were cha |
|
|
* New class names: `FeatureCacheLocalSynchronizer`, `FeatureCacheRemoteSynchronizer`
|
|
|
|
|
|
## Bug Fixes
|
|
|
|
|
|
### Core and Helper Services
|
|
|
|
|
|
### Ingestion services
|
|
|
|
|
|
- Manifest-based Ingestion - Major performance improvement.
|
|
|
- osdu-ingestion-lib - writing records in parallel/concurrent manner into Storage service. See [MR](https://urldefense.com/v3/\__https:/community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-ingestion-lib/-/merge_requests/30_\_;!!GF_29dbcQIUBPA!3PiTTmCUIwwQ6UToa6PfFOgrrAkdvsHADXCXk_QEpa6sG5oPUV6xrdRcoDu2jKjk-\_ar4V9ssumqtnn9kSfqrMapqwDrFqIJlts%24)
|
|
|
- osdu-airflow-lib - Added new Airflow variable core__ingestion__thread_save_number to tune a number of concurrent writings into Storage service for ProcessManifestOperatorR3 operator. This variable is optional (default: 1). See [MR](https://urldefense.com/v3/\__https:/community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib/-/merge_requests/39_\_;!!GF_29dbcQIUBPA!3PiTTmCUIwwQ6UToa6PfFOgrrAkdvsHADXCXk_QEpa6sG5oPUV6xrdRcoDu2jKjk-\_ar4V9ssumqtnn9kSfqrMapqwDr98gQipI%24)
|
... | ... | @@ -159,6 +163,7 @@ No in-place schema changes are required in M15 (no M14 schema resources were cha |
|
|
### DDMS
|
|
|
|
|
|
- `Wellbore DDMS`
|
|
|
- `AWS` - Fixed performance issues for reading wellbore ddms data. See [Issue](https://community.opengroup.org/osdu/platform/pre-shipping/-/issues/298)
|
|
|
- lib updates: [fastAPI 0.70](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/659 "upgrade fastapi 0.70"), [Dask 2022.10.2](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/612 "Upgrade Fsspec and its dependencies: aws, azure, gcp + Dask to LATEST version"), [ffspec and implementations (adfs, s3fs, gcfs ...)](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/612 "Upgrade Fsspec and its dependencies: aws, azure, gcp + Dask to LATEST version"), [PyArrow 9.0.0](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/649 "Enh: upgrade PyArrow library to version 9.0.0 due to lots of improvement on memory consumption side").
|
|
|
- Azure lib: retry mechanism to work around ClientAuthentication issues to blob storage (see [changes](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/lib/wellbore-cloud/wellbore-azure-lib/-/merge_requests/36 "Add new RetryableDefaultAzureIdentity class to authenticate to Azure services"), imported by [!659](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/626 "Change version of OSDU core lib Azure to change the way credentials are...")).
|
|
|
- `Reservoir DMS`
|
... | ... | |