... | ... | @@ -67,8 +67,7 @@ As with M15, M16 does not contain any in-place schema changes (no M15 schema res |
|
|
### Ingestion services
|
|
|
|
|
|
- Manifest-based Ingestion
|
|
|
- It is recommended to use the static-analysis in the CICD. [See details](https://community.opengroup.org/osdu/platform/ci-cd-pipelines/-/blob/master/build/python-linters.yml#L23)
|
|
|
- The analysis is already used [in](https://community.opengroup.org/osdu/platform/system/sdks/common-python-sdk/-/merge_requests/89)
|
|
|
- Implemented code static-analysis in the CICD. [See details](https://community.opengroup.org/osdu/platform/ci-cd-pipelines/-/blob/master/build/python-linters.yml#L23). The analysis is already implemented. See MR [!89](https://community.opengroup.org/osdu/platform/system/sdks/common-python-sdk/-/merge_requests/89)
|
|
|
- SegY to VDS conversion
|
|
|
* `AWS` - Supports now the execution context in SegY to oVDS conversion in sdstore - see [!13](https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-vds-conversion/-/issues/13 "SegY to oVDS conversion in sdstore").
|
|
|
|
... | ... | @@ -158,12 +157,6 @@ As with M15, M16 does not contain any in-place schema changes (no M15 schema res |
|
|
- `Indexer Queue`
|
|
|
- Dependency upgrade. See MR [!289](https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/289)
|
|
|
- Handle slow indexing. See MR [!283](https://community.opengroup.org/osdu/platform/system/indexer-queue/-/merge_requests/283)
|
|
|
- `Segy to Zgy Conversion`
|
|
|
- Bump OpenZgy version to 0.2.968. See MR [!211](https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/-/merge_requests/211)
|
|
|
- `Lib`
|
|
|
- Fix spring-boot-starter vulnerability. See MR [!23](https://community.opengroup.org/osdu/platform/data-flow/ingestion/external-data-sources/eds-dms/-/merge_requests/23)
|
|
|
- `Ingestion Workflow`
|
|
|
- Update dependencies. See MR [!365](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/365)
|
|
|
- `CRS Conversion`
|
|
|
- Mercator bug fixed after using Apache SIS 1.3 library. [See MR](https://community.opengroup.org/osdu/platform/system/reference/crs-conversion-service/-/merge_requests/283 "update to use apache sis 1.3")
|
|
|
- Error Handling for Invalid Input Types. See MR [!291](https://community.opengroup.org/osdu/platform/system/reference/crs-conversion-service/-/merge_requests/291)
|
... | ... | @@ -182,7 +175,11 @@ As with M15, M16 does not contain any in-place schema changes (no M15 schema res |
|
|
|
|
|
- `csv-parser`
|
|
|
- Upgrade SnakeYaml dependency. See MR [!331](https://community.opengroup.org/osdu/platform/data-flow/ingestion/csv-parser/csv-parser/-/merge_requests/331)
|
|
|
|
|
|
- `Segy to Zgy Conversion`
|
|
|
- Bump OpenZgy version to 0.2.968. See MR [!211](https://community.opengroup.org/osdu/platform/data-flow/ingestion/segy-to-zgy-conversion/-/merge_requests/211)
|
|
|
- `Ingestion Workflow`
|
|
|
- Update dependencies. See MR [!365](https://community.opengroup.org/osdu/platform/data-flow/ingestion/ingestion-workflow/-/merge_requests/365)
|
|
|
|
|
|
### DDMS
|
|
|
|
|
|
- `Seismic DDMS`
|
... | ... | @@ -195,32 +192,22 @@ As with M15, M16 does not contain any in-place schema changes (no M15 schema res |
|
|
- FastAPI upgraded to 0.88 - see [!674](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/674 "Upgrade fastapi 0.88.0")
|
|
|
- Adding Well Log performance tests - see [!681](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/681 "Adding Well Log Performance Tests")
|
|
|
- Google - `gcp` renamed `gc` - see [!699](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/merge_requests/699 "GONRG-5894 - gc rename")
|
|
|
- `Reservoir DMS`
|
|
|
- To add
|
|
|
|
|
|
### External Data Services (EDS)
|
|
|
|
|
|
- Reference Value Mapping: Logic must replace only the key and partition id, instead it replaced all "f" with "ft”. The Bug is now fixed. [Issue 263](https://community.opengroup.org/osdu/platform/data-flow/ingestion/external-data-sources/external-data-framework/-/issues/263)
|
|
|
- Ingestion of the Multiple WPC: Fixed the issue from M15 now M16 supports multiple WPC ingestion. [Issue 436](https://community.opengroup.org/osdu/platform/pre-shipping/-/issues/436)
|
|
|
- Provide new variable connectedSourceSchemaAuthority for provider's schemaAuthority [Issue 259](https://community.opengroup.org/osdu/platform/data-flow/ingestion/external-data-sources/external-data-framework/-/issues/259)
|
|
|
- Fix spring-boot-starter vulnerability. See MR [!23](https://community.opengroup.org/osdu/platform/data-flow/ingestion/external-data-sources/eds-dms/-/merge_requests/23)
|
|
|
|
|
|
## Known Issues/Gaps
|
|
|
|
|
|
### Core and Helper Services
|
|
|
|
|
|
- `Service name`
|
|
|
- To add
|
|
|
|
|
|
### Ingestion services
|
|
|
|
|
|
- WITSML Parser
|
|
|
- Tubular. [Known problem and work-around.](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/issues/58)
|
|
|
- Trajectory. [Known problem.](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/issues/63)
|
|
|
|
|
|
### DDMS
|
|
|
|
|
|
- To add
|
|
|
|
|
|
### External Data Services (EDS)
|
|
|
|
|
|
- Duplicity of workflow parameters: since EDS DMS is still using Workflows from connectedSourceDataJob hence we are keeping it in connectedSourceDataJob too as of now. [Issue 11](https://community.opengroup.org/osdu/platform/data-flow/ingestion/external-data-sources/core-external-data-workflow/-/issues/11)
|
... | ... | |