Changes

Page history
Update Release Notes authored by Mohammad Malekmakan's avatar Mohammad Malekmakan
Hide whitespace changes
Inline Side-by-side
Release-Notes.md
View page @ 9c513887
......@@ -8,15 +8,15 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic
* `Data Definitions` To accommodate Wellbore DDMS requirements, WellLog and WellboreTrajectory models have been enhanced. A data model for Activity was added to support Seismic domain's requirement. Take a glance at the exhaustive list of modifications on its [snapshot](https://community.opengroup.org/osdu/data/data-definitions/-/blob/master/E-R/ChangeReport.md#snapshot-2021-04-29).
* `Entitlements` GCP migrated/integrated R2 services to Entitlement v2 - [Go to issue](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/issues/66)
* `Ingestion` CSV Parser Enhancements:
* Search Client escapes special characters. [More Details](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/20)
* [Nested Schema](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/23) Supporting data ingestion into nested attributes and utilizing the metadata file's delimiter characters.
* [Spatial Data Handler](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/22) _EXPLANATION IS REQUIRED_
* [Tokens for long running jobs](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/21) An interface `AuthJwtToken` is added for generating tokens. Regarding implementations are `AwsServiceAccountAuthToken`, `ServiceAccountAuthToken`, and `IBMServicePrincipalAuthToken` classes which needs actual implementation.
* [Multi-thread Optimization](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/26) Every record being read and added as a task to an executor service, where it is enriched and stored with other records Parallelly.
* [ID Generation Standard](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/25) ID is being generated based on OSDU standard now ( `<authority/data-partition-id>:<source>:<entity-type>:<base64-of-xosdu-natural-keys>`).
* [Relationship Enhancement](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/24) In the file metadata record, the `EhxtensionProperties` block now can be used to offer extra details for ingestion and to provide relationship(Schema/Data) information.
* `Ingestion`
* `Ingestion`
* `CSV Parser Enhancements`:
* Search Client escapes special characters. [More Details](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/20)
* [Nested Schema](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/23) Supporting data ingestion into nested attributes and utilizing the metadata file's delimiter characters.
* [Spatial Data Handler](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/22) _EXPLANATION IS REQUIRED_
* [Tokens for long running jobs](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/21) An interface `AuthJwtToken` is added for generating tokens. Regarding implementations are `AwsServiceAccountAuthToken`, `ServiceAccountAuthToken`, and `IBMServicePrincipalAuthToken` classes which needs actual implementation.
* [Multi-thread Optimization](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/26) Every record being read and added as a task to an executor service, where it is enriched and stored with other records Parallelly.
* [ID Generation Standard](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/25) ID is being generated based on OSDU standard now ( `<authority/data-partition-id>:<source>:<entity-type>:<base64-of-xosdu-natural-keys>`).
* [Relationship Enhancement](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/24) In the file metadata record, the `EhxtensionProperties` block now can be used to offer extra details for ingestion and to provide relationship(Schema/Data) information.
* `Manifest-based Ingestion` Performance improvements by adding cache for Search ID handler. [Find out more](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/62)
* `Airflow 2.0 Migration` (In progress):
* Changes for WITSML DAG to be compatible with Airflow 2.0. [Read more](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/61)
......
......