Changes

Page history
Update M17 Release Notes authored by Chad Leong's avatar Chad Leong
Show whitespace changes
Inline Side-by-side
M17-Release-Notes.md
View page @ cc6478e6
# Milestone M17
To be released on 28-Apr-2023
To be released on 5-May-2023 tentatively
## :exclamation: Important Note
### Breaking Changes
- `Seismic DDMS`
- Deprecated Azure database model is not supported anymore. Refer [here](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-service/-/wikis/Seismic-DMS-on-Azure-database-model-deprecation) for more info.
### Experimental Features
In keeping with our policy of releasing new capabilities early and often for feedback, we are pleased to introduce several new **experimental/early release** platform capabilities in this milestone release. These are currently only available in specific cloud service providers with limited scopes and functionalities, future milestone release will include more CSP support. Please refer to the details below.
- [`Policy service (Experimental/Early Release)`](https://community.opengroup.org/osdu/platform/security-and-compliance/policy) - `AWS`, `Azure`, `IBM`, `GCP`
- `GCP` Performance issue is noted during preship testing, `Policy` service is **OFF** by default.
- `AWS` Policy service is **ON** by default.
- `Azure` Policy service is **ON** by default.
- `IBM` Policy service is **OFF** by default.
- [`Reservoir DDMS (Experimental/Early Release)`](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/reservoir) - `Azure`, `IBM`
- [`External Data Services (Experimental/Early Release)`](https://community.opengroup.org/osdu/platform/data-flow/ingestion/external-data-sources) - `Azure`, `GCP`, `AWS`
- [`Geospatial Consumption Zone (Experimental/Early Release)`](https://community.opengroup.org/osdu/platform/consumption/geospatial) - `IBM`
- [`Manifest ingestion by reference (Experimental/Early Release)`](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib/-/merge_requests/17 "Manifest by reference, first code version") - `GCP`, `IBM`, `AWS`, `Azure`
### Deprecation Notice
TBD
# Table of Content
......@@ -36,27 +60,17 @@ As with recent milestones, M17 does not contain any in-place schema changes (no
* **_Note:_** The implicit changes via AbstractWPCGroupType:1.1.0 to WellboreIntervalSet:1.1.0 and WellboreMarkerSet:1.3.0 are also not yet supported by the Wellbore DDMS in M17.
### Core and Helper Services
- `Schema`
- To add
- `Register`
- To add
- `Indexer`
- To add
- `Lib`
- To add
- Enable geo-shape decimation for all the kinds that have spatial location. See MR [!498](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/498)
- `Schema`
- Resolve "OSDU-DD-Delivery-M17 (v0.20.0)". See MR [!458](https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/458)
- `Storage`
- To add
- `Indexer Queue`
- To add
- `Policy`
- To add
- Added modify user and time info. See MR [!642](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/642)
- Extend patch API to support data block modification. See MR [!639](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/639)
### Ingestion services
- Manifest-based Ingestion
- To add
- SegY to VDS conversion
* To add
- `Segy to Zgy Conversion`
- Major performance work, adding GSM logging module and created authentication plugin framework module.. See MR [!195](https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/-/merge_requests/195)
### DDMS
......@@ -120,38 +134,28 @@ In an effort to align the GCZ project's structure more closely with other OSDU C
### Core and Helper Services
- `Lib`
- To add
- `Partition`
- To add
- `Indexer`
- To add
- `Search`
- To add
- `File`
- To add
- `Unit`
- To add
- `Dataset`
- To add
- `Storage`
- To add
- Ignore unmapped fields on geo-queries. See MR [!454](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/454)
- Set IndicesOptions ignoreUnavailable to be true to skip the non-exist indices in the SearchRequest. See MR [!450](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/450)
- Use VMCache instead of map in memory to cache the index aliases. See MR [!447](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/447)
- Added policy error handling (GONRG-6457). See MR [!445](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/445)
- `Indexer`
- Add validation and ignore out of order message when kind is updated. See MR [!511](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/511)
- Use Index API to update the record. See MR [!488](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/488)
- Don't throw exception on property block (with special character) on geojson. See MR [!364](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/364)
- `Schema`
- To add
- `Notification`
- To add
- `Indexer Queue`
- To add
- `CRS Conversion`
- To add
- `Unit`
- To add
- `Legal`
- To add
- `Entitlements`
- To add
- `Policy`
- To add
- Continue build if dependency-maven-check failed. See MR [!468](https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/468)
- `Storage`
- Patch fixes. See MR [!665](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/665)
- Spatial location array. See MR [!644](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/644)
- `File`
- Fix for premature staging file deletion for issue#76. See MR [!426](https://community.opengroup.org/osdu/platform/system/file/-/merge_requests/426)
- `Register`
- Fix validation regex for localid. See MR [!317](https://community.opengroup.org/osdu/platform/system/register/-/merge_requests/317)
### Ingestion services
- `osdu-ingestion-lib`
- Fix: file source validator. See MR [!45](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-ingestion-lib/-/merge_requests/45)
### DDMS
......@@ -182,11 +186,47 @@ In an effort to align the GCZ project's structure more closely with other OSDU C
#### Transformer Bug Fixes
* Resolved JSON Exception error when Transformer encountered empty arrays during 3D Seismic record ingestion ([afb4eb56](https://community.opengroup.org/osdu/platform/consumption/geospatial/-/merge_requests/90/diffs?commit_id=afb4eb56aff3f8d172b524e6965732959ae5c0d1))
## :exclamation: Breaking Changes
## Enhancements
### Core and Helper Services
- `Search`
- Generate Swagger using springdoc-openapi OAS 3.0. See MR [!459](https://community.opengroup.org/osdu/platform/system/search-service/-/merge_requests/459)
- `Indexer`
- Added logs for not found records. See MR [!502](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/502)
- Enable the feature flag for geo-shape decimation by default. See MR [!486](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/486)
- No retry on storage 500. See MR [!454](https://community.opengroup.org/osdu/platform/system/indexer-service/-/merge_requests/454)
- `Schema`
- OpenAPI 3.0 Documentation using springdoc. See MR [!470](https://community.opengroup.org/osdu/platform/system/schema-service/-/merge_requests/470)
- `Storage`
- Handling data inconsistency. See MR [!650](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/650)
- Added logs for not found records. See MR [!648](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/648)
- Added logs for not found records. See MR [!643](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/643)
- Remove not necessary content header requirement. See MR [!634](https://community.opengroup.org/osdu/platform/system/storage/-/merge_requests/634)
- `Indexer Queue`
- Add correlation and data-partition id to custom metric. See MR [!321](https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/321)
- `File`
- Generate Swagger using springdoc-openapi OAS 3.0. See MR [!433](https://community.opengroup.org/osdu/platform/system/file/-/merge_requests/433)
- `Dataset`
- Remove deprecated functions from DatasetDmsApi. See MR [!319](https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/319)
- Generate Swagger using springdoc-openapi OAS 3.0. See MR [!317](https://community.opengroup.org/osdu/platform/system/dataset/-/merge_requests/317)
- `Notification`
- Add subscriber notification request request/dependency logging. See MR [!348](https://community.opengroup.org/osdu/platform/system/notification/-/merge_requests/348)
- `Register`
- OpenAPI 3.0 Documentation using springdoc. See MR [!332](https://community.opengroup.org/osdu/platform/system/register/-/merge_requests/332)
- `Partition`
- Generate Swagger using springdoc-openapi OAS 3.0. See MR [!359](https://community.opengroup.org/osdu/platform/system/partition/-/merge_requests/359)
- `Legal`
- Generate Swagger using springdoc-openapi OAS 3.0. See MR [!370](https://community.opengroup.org/osdu/platform/security-and-compliance/legal/-/merge_requests/370)
- `Entitlements`
- Generate Swagger using springdoc-openapi OAS 3.0. See MR [!448](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/merge_requests/448)
- `Secret`
- List secret by name and deprecate listing of all secrets. See MR [!59](https://community.opengroup.org/osdu/platform/security-and-compliance/secret/-/merge_requests/59)
### Ingestion services`
- `osdu-airflow-lib`
- Put_file api call for uploading the file to datasetdms client. See MR [!52](https://community.opengroup.org/osdu/platform/data-flow/ingestion/osdu-airflow-lib/-/merge_requests/52)
### DDMS
- `Seismic DDMS`
- Deprecated Azure database model is not supported anymore. Refer [here](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic/seismic-dms-suite/seismic-store-service/-/wikis/Seismic-DMS-on-Azure-database-model-deprecation) for more info.
## Known Issues/Gaps
### Ingestion services
......
......