Update Release Notes authored by Mohammad Malekmakan's avatar Mohammad Malekmakan
...@@ -8,7 +8,8 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic ...@@ -8,7 +8,8 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic
* `Data Definitions` To accommodate Wellbore DDMS requirements, WellLog and WellboreTrajectory models have been enhanced. A data model for Activity was added to support Seismic domain's requirement. Take a glance at the exhaustive list of modifications on its [snapshot](https://community.opengroup.org/osdu/data/data-definitions/-/blob/master/E-R/ChangeReport.md#snapshot-2021-04-29). * `Data Definitions` To accommodate Wellbore DDMS requirements, WellLog and WellboreTrajectory models have been enhanced. A data model for Activity was added to support Seismic domain's requirement. Take a glance at the exhaustive list of modifications on its [snapshot](https://community.opengroup.org/osdu/data/data-definitions/-/blob/master/E-R/ChangeReport.md#snapshot-2021-04-29).
* `Entitlements` GCP migrated/integrated R2 services to Entitlement v2 - [Go to issue](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/issues/66) * `Entitlements` GCP migrated/integrated R2 services to Entitlement v2 - [Go to issue](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/issues/66)
* `Ingestion` CSV Parser Enhancements: * `Ingestion`
* `CSV Parser Enhancements`:
* Search Client escapes special characters. [More Details](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/20) * Search Client escapes special characters. [More Details](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/20)
* [Nested Schema](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/23) Supporting data ingestion into nested attributes and utilizing the metadata file's delimiter characters. * [Nested Schema](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/23) Supporting data ingestion into nested attributes and utilizing the metadata file's delimiter characters.
* [Spatial Data Handler](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/22) _EXPLANATION IS REQUIRED_ * [Spatial Data Handler](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/22) _EXPLANATION IS REQUIRED_
...@@ -16,7 +17,6 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic ...@@ -16,7 +17,6 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic
* [Multi-thread Optimization](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/26) Every record being read and added as a task to an executor service, where it is enriched and stored with other records Parallelly. * [Multi-thread Optimization](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/26) Every record being read and added as a task to an executor service, where it is enriched and stored with other records Parallelly.
* [ID Generation Standard](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/25) ID is being generated based on OSDU standard now ( `<authority/data-partition-id>:<source>:<entity-type>:<base64-of-xosdu-natural-keys>`). * [ID Generation Standard](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/25) ID is being generated based on OSDU standard now ( `<authority/data-partition-id>:<source>:<entity-type>:<base64-of-xosdu-natural-keys>`).
* [Relationship Enhancement](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/24) In the file metadata record, the `EhxtensionProperties` block now can be used to offer extra details for ingestion and to provide relationship(Schema/Data) information. * [Relationship Enhancement](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/24) In the file metadata record, the `EhxtensionProperties` block now can be used to offer extra details for ingestion and to provide relationship(Schema/Data) information.
* `Ingestion`
* `Manifest-based Ingestion` Performance improvements by adding cache for Search ID handler. [Find out more](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/62) * `Manifest-based Ingestion` Performance improvements by adding cache for Search ID handler. [Find out more](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/62)
* `Airflow 2.0 Migration` (In progress): * `Airflow 2.0 Migration` (In progress):
* Changes for WITSML DAG to be compatible with Airflow 2.0. [Read more](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/61) * Changes for WITSML DAG to be compatible with Airflow 2.0. [Read more](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/61)
... ...
......