Milestone 7 - August 20, 2021 (Released)

For detailed services that are included in this release, please refer to M7 tagging notes:

• R3 Milestone 7 deliverables - 0.10.0

New Features

• Data Definitions To accommodate Wellbore DDMS requirements, WellLog and WellboreTrajectory models have been enhanced. A data model for Activity was added to support Seismic domain's requirement. Take a glance at the exhaustive list of modifications on its snapshot.
• Core Services
  • Version info. endpoint been added partially; only in Storage Service.
  • Entitlement V2 Updated Entitlement service is now available on all cloud platforms
• Ingestion
  • CSV Parser Enhancements:
    • Search Client escapes special characters. More Details
    • Nested Schema Supporting data ingestion into nested attributes and utilizing the metadata file's delimiter characters.
    • Spatial Data Handler
    • Tokens for long running jobs An interface AuthJwtToken is added for generating tokens. Regarding implementations are AwsServiceAccountAuthToken, ServiceAccountAuthToken, and IBMServicePrincipalAuthToken classes which needs actual implementation.
    • Multi-thread Optimization Every record being read and added as a task to an executor service, where it is enriched and stored with other records Parallelly.
    • ID Generation Standard ID is being generated based on OSDU standard now ( <authority/data-partition-id>:<source>:<entity-type>:<base64-of-xosdu-natural-keys>).
    • Relationship Enhancement In the file metadata record, the EhxtensionProperties block now can be used to offer extra details for ingestion and to provide relationship(Schema/Data) information.
  • Manifest-based Ingestion Performance improvements by adding cache for Search ID handler. Find out more
  • WITSML Ingestion is supported on AWS IBM
• Python SDK
  • Supporting Entitlement v2
  • Entitlement CLI is added
  • Some refactoring See more
• Seismic Ingestion OpenVDS and OpenZGY format conversion features are now available
  • OpenVDS supported on AWS GCP IBM
  • OpenZGY supported on GCP IBM Azure
• E&O Improvement on the experimental Entitlements & Obligations feature: Default policies bootstrapped for ensuring Policy Service operational readiness to guarantee consistent current behavior. Find out more

Bug Fixes

• Ingestion
  • When calling Workflow API, User receives 401/403 as a valid HTTP code if s/he is not a valid User or does not have any Entitlements Groups. See More Here
  • New version of WITSML parser does not pass date-time validation. Now, date-time fields must follow RFC3339 standard. more information here and here.
• Security Known Vulnerabilities in 3rd Party Dependent Libraries resolved. See More Here

Breaking Changes

Deprecation Notice

Storage
Given that Storage Service Schema Management does not support R3 schemas, we should avoid employing two services to facilitate schema management since the majority of users already use the Schema Service. As a result, we propose phasing out Storage Service Schema Management as soon as possible.

As a NOTICE, some Storage Schema APIs have been marked as deprecated and will be eliminated from the M8 release.

Known Issues

• CSV Parser is not available for AWS as for now due to the issue of loading reference Data.
• New Policy Service is an experimental feature, meant to be deployed in a dedicated test partition for evaluation and community feedback. It is not recommended to be enabled in production environments as there is a known impact in manifest-based Ingestion (integrity check)