... | ... | @@ -10,63 +10,76 @@ For detailed services that are included in this release, please refer to M11 tag |
|
|
|
|
|
* `Data Definition` - Refer here for [full changes "OSDU schemas"](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/ChangeReport.md#snapshot-2022-01-14-towards-m11) and [full changes "OSDU reference-values"](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/ChangeLogs/M11/README.md)
|
|
|
* Schema Highlights
|
|
|
* Indexing Hint **Changes** for work-product-component--DataQuality and reference-data--QualityDataRuleSet: all
|
|
|
records referring to these kinds **_must be re-indexed_** to make the changes take effect. This also changed the
|
|
|
query syntax. It is not expected that a large number of such records are in production use. see
|
|
|
also [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/README.md).
|
|
|
* LogCurveType and LogCurveFamily augmented with explicit relationships.
|
|
|
* New schemas for Earth Modelling/Reservoir: Aquifer - [Introduction via examples](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/Reservoir%20Data/Aquifer/README.md)
|
|
|
* Integration of Seismic, Well and Earth Modelling/Reservoir via stratigraphy
|
|
|
* [Introduction via Stratigraphy examples, including **new WellboreIntervalSet**](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/Reservoir%20Data/Stratigraphy/README.md), explaining the interrelations between 'tops', intervals and interpretations (eventually relating to feature instances). See [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/README.md)
|
|
|
* The new [SeismicFault:1.0.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/SeismicFault.1.0.0.md) and [SeismicHorizon:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/SeismicHorizon.1.1.0.md) become 'representations' and can be included in [UnsealedSurfaceFramework](https://community.opengroup.org/osdu/data/data-definitions/-/tree/v0.14.0/E-R/work-product-component/UnsealedSurfaceFramework.1.1.0.md). [FaultSystem:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/SeismicFault.1.0.0.md) links to FaultInterpretations. See also [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/README.md)
|
|
|
* Well Execution: [FluidsReport:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/master-data/FluidsReport.1.1.0.md) extension and corrections to VirtualProperties DefaultName definitions.
|
|
|
* Well Delivery: [WellLog:1.2.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/WellLog.1.2.0.md) got extended with curve sample types (reference values) and log remarks. See also [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/WellLog.1.1.0.md)
|
|
|
* New unit symbol mapping support via [ExternalUnitOfMeasure and related, see worked example for use cases](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/UnitOfMeasureLookUp/README.md).
|
|
|
* Enhancement to [Organisation:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/master-data/Organisation.1.1.0.md) supporting hierarchical structures, [example](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/Organisation/README.md).
|
|
|
* Documentation changes, including
|
|
|
* Changes of some reference value types' descriptions to align with the PPDM sources.
|
|
|
* Moved WorkedExamples folders to names without the schema version numbers as most examples are version independent or updated to the latest schema version where necessary.
|
|
|
* Minor enhancements to the [Schema Usage Guide](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/README.md)
|
|
|
* Example CRS record `id`s adjusted to the new OSDU default CRS Catalog conventions.
|
|
|
* Reference Value Highlights
|
|
|
* **_New_**, Geomatics approved default CRS Catalog content in the form of a large [reference value manifest file](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/CRS_CT.json). The
|
|
|
governance is still LOCAL and large operators will replace the content entirely. A new record `id`-convention
|
|
|
has been established to enable data exchange across environments and matching reference values with identical
|
|
|
behaviour.
|
|
|
* Content for [UnitOfMeasureConfiguration](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/UnitOfMeasureConfiguration.1.0.0.json) with content provided by ExxonMobil and Shell. This LOCAL data set is only considered an example.
|
|
|
* Example content for [ExternalUnitOfMeasure](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/ExternalUnitOfMeasure.1.0.0.json), [ExternalUnitQuantity](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/ExternalUnitQuantity.1.0.0.json) and [ExternalCatalogNamespace](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/ExternalCatalogNamespace.1.0.0.json) corresponding to the new schemas published above.
|
|
|
* PPDM alignment: a number of reference value catalogs are curated by PPDM. PPDM is then the source and provides PPDM style workbooks, which are parsed and turned into reference value manifests. OSDU adopts the description of the reference value catalog from PPDM.
|
|
|
* Indexing Hint **Changes** for work-product-component--DataQuality and reference-data--QualityDataRuleSet: all records referring to these kinds **_must be re-indexed_** to make the changes take effect. This also changed the query syntax. It is not expected that a large number of such records are in production use. see also [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/README.md).
|
|
|
* LogCurveType and LogCurveFamily augmented with explicit relationships.
|
|
|
* New schemas for Earth Modelling/Reservoir: Aquifer - [Introduction via examples](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/Reservoir%20Data/Aquifer/README.md)
|
|
|
* Integration of Seismic, Well and Earth Modelling/Reservoir via stratigraphy
|
|
|
* [Introduction via Stratigraphy examples, including **new WellboreIntervalSet**](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/Reservoir%20Data/Stratigraphy/README.md), explaining the interrelations between 'tops', intervals and interpretations (eventually relating to feature instances). See [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/README.md)
|
|
|
* The new [SeismicFault:1.0.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/SeismicFault.1.0.0.md) and [SeismicHorizon:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/SeismicHorizon.1.1.0.md) become 'representations' and can be included in [UnsealedSurfaceFramework](https://community.opengroup.org/osdu/data/data-definitions/-/tree/v0.14.0/E-R/work-product-component/UnsealedSurfaceFramework.1.1.0.md). [FaultSystem:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/SeismicFault.1.0.0.md) links to FaultInterpretations. See also [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/README.md)
|
|
|
* Well Execution: [FluidsReport:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/master-data/FluidsReport.1.1.0.md) extension and corrections to VirtualProperties DefaultName definitions.
|
|
|
* Well Delivery: [WellLog:1.2.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/work-product-component/WellLog.1.2.0.md) got extended with curve sample types (reference values) and log remarks. See also [Migration Guides](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/MigrationGuides/M11/WellLog.1.1.0.md)
|
|
|
* New unit symbol mapping support via [ExternalUnitOfMeasure and related, see worked example for use cases](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/UnitOfMeasureLookUp/README.md).
|
|
|
* Enhancement to [Organisation:1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/E-R/master-data/Organisation.1.1.0.md) supporting hierarchical structures, [example](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Examples/WorkedExamples/Organisation/README.md).
|
|
|
* Documentation changes, including
|
|
|
* Changes of some reference value types' descriptions to align with the PPDM sources.
|
|
|
* Moved WorkedExamples folders to names without the schema version numbers as most examples are version independent or updated to the latest schema version where necessary.
|
|
|
* Minor enhancements to the [Schema Usage Guide](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/README.md)
|
|
|
* Example CRS record `id`s adjusted to the new OSDU default CRS Catalog conventions.
|
|
|
* Reference Value Highlights
|
|
|
* **_New_**, Geomatics approved default CRS Catalog content in the form of a large [reference value manifest file](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/CRS_CT.json). The governance is still LOCAL and large operators will replace the content entirely. A new record `id`-convention has been established to enable data exchange across environments and matching reference values with identical behaviour.
|
|
|
* Content for [UnitOfMeasureConfiguration](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/UnitOfMeasureConfiguration.1.0.0.json) with content provided by ExxonMobil and Shell. This LOCAL data set is only considered an example.
|
|
|
* Example content for [ExternalUnitOfMeasure](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/ExternalUnitOfMeasure.1.0.0.json), [ExternalUnitQuantity](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/ExternalUnitQuantity.1.0.0.json) and [ExternalCatalogNamespace](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/ReferenceValues/Manifests/reference-data/LOCAL/ExternalCatalogNamespace.1.0.0.json) corresponding to the new schemas published above.
|
|
|
* PPDM alignment: a number of reference value catalogs are curated by PPDM. PPDM is then the source and provides PPDM style workbooks, which are parsed and turned into reference value manifests. OSDU adopts the description of the reference value catalog from PPDM.
|
|
|
* Minor [Online Schema Usage Guide](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Guides/README.md) improvements.
|
|
|
* `Seismic DDMS`
|
|
|
* Add policy service integration for authz checks using feature flags [!308](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-service/-/merge_requests/308)
|
|
|
* Added upload/download connection string endpoint [!332](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-service/-/merge_requests/332)
|
|
|
* `WDMS`
|
|
|
* Python version upgraded to 3.8 (support of 3.7 dropped)
|
|
|
* Third party libs upgrade:
|
|
|
* [pandas 1.4.1](https://pandas.pydata.org/pandas-docs/stable/whatsnew/v1.4.1.html)
|
|
|
* [numpy 1.22.2](https://numpy.org/devdocs/release/1.22.2-notes.html) (security fix)
|
|
|
* [dask 2022.2.0](https://pypi.org/project/dask/2022.2.0/)
|
|
|
* [pyarrow 7.0.0](https://arrow.apache.org/blog/2022/02/08/7.0.0-release/)
|
|
|
* set dask worker time-to-live (memory management) related to [issue 26](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/issues/26)
|
|
|
* Model: add support of `TechnicalAssuranceID` field. (see [AbstractCommonResources schema](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Authoring/abstract/AbstractCommonResources.1.0.0.json#L53))
|
|
|
* API: add record version in bulk [session commit response](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/blob/release/0.14/spec/generated/openapi.json#/WellLog/complete_session_ddms_v3_welllogs__record_id__sessions__session_id__patch).
|
|
|
* [WellLog](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/WellLog-consistency-rules) & [Wellbore Trajectory](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/WellboreTrajectory-consistency-rules) consistency rules.
|
|
|
* `Core Services`
|
|
|
* `file `or `file-dms` rationalization for file collections _\[MSFT to confirm\]_
|
|
|
* `Data Ingestion`
|
|
|
* CSV ingestion on AWS _\[Fabien to five detail or issue number\]_
|
|
|
* `DDMS`
|
|
|
* `Seismic DDMS`
|
|
|
* Add policy service integration for authz checks using feature flags [!308](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-service/-/merge_requests/308)
|
|
|
* Added upload/download connection string endpoint [!332](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-service/-/merge_requests/332)
|
|
|
* `Wellbore DDMS`
|
|
|
* Python version upgraded to 3.8 (support of 3.7 dropped)
|
|
|
* Third party libs upgrade:
|
|
|
* [pandas 1.4.1](https://pandas.pydata.org/pandas-docs/stable/whatsnew/v1.4.1.html)
|
|
|
* [numpy 1.22.2](https://numpy.org/devdocs/release/1.22.2-notes.html) (security fix)
|
|
|
* [dask 2022.2.0](https://pypi.org/project/dask/2022.2.0/)
|
|
|
* [pyarrow 7.0.0](https://arrow.apache.org/blog/2022/02/08/7.0.0-release/)
|
|
|
* set dask worker time-to-live (memory management) related to [issue 26](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/issues/26 "memory leak with data chunking")
|
|
|
* Model: add support of `TechnicalAssuranceID` field. (see [AbstractCommonResources schema](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.14.0/Authoring/abstract/AbstractCommonResources.1.0.0.json#L53))
|
|
|
* API: add record version in bulk [session commit response](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/blob/release/0.14/spec/generated/openapi.json#/WellLog/complete_session_ddms_v3_welllogs__record_id__sessions__session_id__patch).
|
|
|
* [WellLog](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/WellLog-consistency-rules) & [Wellbore Trajectory](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/WellboreTrajectory-consistency-rules) consistency rules.
|
|
|
* `Well Delivery DDMS`
|
|
|
* Duplications are removed and refactoring is done on `core-client` and `core-common` packages. Read more [here](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/well-delivery/well-delivery/-/issues/11).
|
|
|
* `Audit and Metrics`
|
|
|
|
|
|
## Bug Fixes
|
|
|
|
|
|
* `Core Services`
|
|
|
* Fixes to GCP "Info" endpoints (`api/unit/v3/info` & `api/workflow/v1/info` &` api/crs/catalog/v2/info`), Workflow and Unit are applied.
|
|
|
*
|
|
|
* `DDMS`
|
|
|
* `Seismic DDMS`
|
|
|
* General bug fixes & stability improvement. Refer to [service](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-service/-/wikis/Releases), [sdapi](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-cpp-lib/-/wikis/Releases), and [sdutil](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-sdutil/-/wikis/Releases) for detailed notes
|
|
|
* `WDMS`
|
|
|
- Unit tests: speed improvement & test fixtures review.
|
|
|
- Dask cluster properly closed at shutdown.
|
|
|
- Pydantic fix field type Union (e.g. field union[float, str])
|
|
|
- Performance improvement on Bulk Data Describe API.
|
|
|
- Improvement on read bulk, internal read function asynchronous.
|
|
|
- Improvement on read bulk, performance improvement when a lot of columns is requested.
|
|
|
- Fix on [BulkURI consistency check rule](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/BulkURI-consistency-check-rule).
|
|
|
- Technical debt reduction: fix some circular dependencies.
|
|
|
- Monitoring, fix duplicate and long URL for Azure traces.
|
|
|
* `Wellbore DDMS`
|
|
|
- Unit tests: speed improvement & test fixtures review.
|
|
|
- Dask cluster properly closed at shutdown.
|
|
|
- Pydantic fix field type Union (e.g. field union\[float, str\])
|
|
|
- Performance improvement on Bulk Data Describe API.
|
|
|
- Improvement on read bulk, internal read function asynchronous.
|
|
|
- Improvement on read bulk, performance improvement when a lot of columns is requested.
|
|
|
- Fix on [BulkURI consistency check rule](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/BulkURI-consistency-check-rule).
|
|
|
- Technical debt reduction: fix some circular dependencies.
|
|
|
- Monitoring, fix duplicate and long URL for Azure traces.
|
|
|
* `Well Delivery DDMS`
|
|
|
* Memory Leak with data chunking [issue ](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/issues/26)has been resolved.
|
|
|
|
|
|
## Breaking Changes
|
|
|
|
|
|
* `WDMS`
|
|
|
* [WellLog](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/WellLog-consistency-rules) & [Wellbore Trajectory](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/wikis/WellboreTrajectory-consistency-rules) consistency rules.
|
|
|
|
|
|
## Known Issues/Gaps |
|
|
\ No newline at end of file |
|
|
## Known Issues/Gaps
|
|
|
|
|
|
_None Identified_ |
|
|
\ No newline at end of file |