Update Release Notes authored by Kateryna Kurach (EPAM)'s avatar Kateryna Kurach (EPAM)
...@@ -7,6 +7,7 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic ...@@ -7,6 +7,7 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic
## New Features ## New Features
* `E&O` Default policies bootstrapped for ensuring [Policy Service](https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/wikis/Policy-service) operational readiness to guarantee consistent current behavior. [Find out more](https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/issues/10) * `E&O` Default policies bootstrapped for ensuring [Policy Service](https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/wikis/Policy-service) operational readiness to guarantee consistent current behavior. [Find out more](https://community.opengroup.org/osdu/platform/security-and-compliance/policy/-/issues/10)
* `Entitlements v2` – GCP migration to Entitlements v2 - https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/issues/66
* `Ingestion` CSV Parser Enhancements: * `Ingestion` CSV Parser Enhancements:
* Search Client escapes special characters. [More Details](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/20) * Search Client escapes special characters. [More Details](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/20)
* [Nested Schema](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/23) Supporting data ingestion into nested attributes and utilizing the metadata file's delimiter characters. * [Nested Schema](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/23) Supporting data ingestion into nested attributes and utilizing the metadata file's delimiter characters.
...@@ -15,12 +16,26 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic ...@@ -15,12 +16,26 @@ OSDU R3 Milestone 7 is released on Aug 13, 2021 (tentative). For detailed servic
* [Multi-thread Optimization](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/26) Every record being read and added as a task to an executor service, where it is enriched and stored with other records Parallelly. * [Multi-thread Optimization](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/26) Every record being read and added as a task to an executor service, where it is enriched and stored with other records Parallelly.
* [ID Generation Standard](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/25) ID is being generated based on OSDU standard now ( `<authority/data-partition-id>:<source>:<entity-type>:<base64-of-xosdu-natural-keys>`). * [ID Generation Standard](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/25) ID is being generated based on OSDU standard now ( `<authority/data-partition-id>:<source>:<entity-type>:<base64-of-xosdu-natural-keys>`).
* [Relationship Enhancement](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/24) In the file metadata record, the `EhxtensionProperties` block now can be used to offer extra details for ingestion and to provide relationship(Schema/Data) information. * [Relationship Enhancement](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/issues/24) In the file metadata record, the `EhxtensionProperties` block now can be used to offer extra details for ingestion and to provide relationship(Schema/Data) information.
* ` Manifest-based ingestion ` performance improvements:
* [Add cache for Search ID handler](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/62)
* `Ingestion` – Airflow 2.0 migration (In progress):
* [Implement code changes for WITSML DAG to be compatible with Airflow 2.0](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/61)
* [Implement code changes for Manifest-based ingestion DAG to be compatible with Airflow 2.0](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/60)
* `Python SDK updates`[Entitlements support and refactoring](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-dags/-/issues/73)
* ` Seismic DDMS` :
* GCP integration with ZGY parser
* GCP integration with OpenVDS parser
* `Data Definitions and Services` To accommodate Wellbore DDMS, a data model for Activity was added, as well as improvements to WellLog and WellboreTrajectory. Take a glance at the exhaustive list of modifications on its [snapshot](https://community.opengroup.org/osdu/data/data-definitions/-/blob/master/E-R/ChangeReport.md#snapshot-2021-04-29). * `Data Definitions and Services` To accommodate Wellbore DDMS, a data model for Activity was added, as well as improvements to WellLog and WellboreTrajectory. Take a glance at the exhaustive list of modifications on its [snapshot](https://community.opengroup.org/osdu/data/data-definitions/-/blob/master/E-R/ChangeReport.md#snapshot-2021-04-29).
## Bug Fixes ## Bug Fixes
* `Ingestion` When calling Workflow API, User receives 401/403 as a valid HTTP code if s/he is not a valid User or does not have any Entitlements Groups. [See More Here](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/issues/95) * `Ingestion` When calling Workflow API, User receives 401/403 as a valid HTTP code if s/he is not a valid User or does not have any Entitlements Groups. [See More Here](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/issues/95)
* `Security` Known Vulnerabilities in 3rd Party Dependent Libraries resolved. [See More Here](https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/44) * `Security` Known Vulnerabilities in 3rd Party Dependent Libraries resolved. [See More Here](https://community.opengroup.org/osdu/platform/system/lib/core/os-core-common/-/issues/44)
* `WITSML` New version of WITSML parser doesn't pass date-time validation [See More Here]( https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics-osdu-integration/-/issues/39)
## Breaking Changes ## Breaking Changes
... ...
......