... | @@ -61,6 +61,7 @@ See [Issue #46 Converter Service](https://community.opengroup.org/osdu/platform/ |
... | @@ -61,6 +61,7 @@ See [Issue #46 Converter Service](https://community.opengroup.org/osdu/platform/ |
|
- `Ingestion Services`
|
|
- `Ingestion Services`
|
|
* `Manifest Ingestion`
|
|
* `Manifest Ingestion`
|
|
* `Manifest Ingestion by Reference`
|
|
* `Manifest Ingestion by Reference`
|
|
|
|
* Available in GCP only. (other CSPs to follow later)
|
|
* _Ingestion By Reference_ feature <span dir="">stores only the `Record_Id` of a manifest into the `XCOM` context and access it from the different DAGS/operators. Ingestion can now be triggered by a `record_id` (of a manifest uploaded on the DatasetService) instead of a complete manifest. This can eventually enhance the performance</span>. Read more in [MR ](https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcommunity.opengroup.org%2Fosdu%2Fplatform%2Fdata-flow%2Fingestion%2Fosdu-airflow-lib%2F-%2Fmerge_requests%2F17&data=05%7C01%7Cmohammad.malekmakan%40petronas.com%7C53829753901f4dae1bb208da78778108%7C3b2e894179484131978ab2dfc7295091%7C0%7C0%7C637954751953159322%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yXNuEIh43iHhHPq5PCga7SkQp7WNV0hC3GBjOtqRXRo%3D&reserved=0)or see the [Postman collection](https://community.opengroup.org/osdu/platform/testing/-/tree/master/Dev/Manifest_By_Reference).
|
|
* _Ingestion By Reference_ feature <span dir="">stores only the `Record_Id` of a manifest into the `XCOM` context and access it from the different DAGS/operators. Ingestion can now be triggered by a `record_id` (of a manifest uploaded on the DatasetService) instead of a complete manifest. This can eventually enhance the performance</span>. Read more in [MR ](https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcommunity.opengroup.org%2Fosdu%2Fplatform%2Fdata-flow%2Fingestion%2Fosdu-airflow-lib%2F-%2Fmerge_requests%2F17&data=05%7C01%7Cmohammad.malekmakan%40petronas.com%7C53829753901f4dae1bb208da78778108%7C3b2e894179484131978ab2dfc7295091%7C0%7C0%7C637954751953159322%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yXNuEIh43iHhHPq5PCga7SkQp7WNV0hC3GBjOtqRXRo%3D&reserved=0)or see the [Postman collection](https://community.opengroup.org/osdu/platform/testing/-/tree/master/Dev/Manifest_By_Reference).
|
|
* `CSV Ingestion`
|
|
* `CSV Ingestion`
|
|
* `WITSML Parser`
|
|
* `WITSML Parser`
|
... | @@ -74,7 +75,7 @@ See [Issue #46 Converter Service](https://community.opengroup.org/osdu/platform/ |
... | @@ -74,7 +75,7 @@ See [Issue #46 Converter Service](https://community.opengroup.org/osdu/platform/ |
|
- Offers two APIs, a REST API and a Energistics Transfer Protocol API to ingest and retrieve reservoir models using Energistics RESQML standard.
|
|
- Offers two APIs, a REST API and a Energistics Transfer Protocol API to ingest and retrieve reservoir models using Energistics RESQML standard.
|
|
- The very first release of this feature.
|
|
- The very first release of this feature.
|
|
- Partial implementation includes ETP server and ETP client
|
|
- Partial implementation includes ETP server and ETP client
|
|
- Implemented in Azure only
|
|
- Implemented in Azure only (other CSPs to follow later)
|
|
- `Wellbore DDMS`
|
|
- `Wellbore DDMS`
|
|
- Issue [#43](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/issues/43), adding support of:
|
|
- Issue [#43](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore/wellbore-domain-services/-/issues/43), adding support of:
|
|
- [well schema 1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.15.0/E-R/master-data/Well.1.1.0.md)
|
|
- [well schema 1.1.0](https://community.opengroup.org/osdu/data/data-definitions/-/blob/v0.15.0/E-R/master-data/Well.1.1.0.md)
|
... | @@ -84,7 +85,7 @@ See [Issue #46 Converter Service](https://community.opengroup.org/osdu/platform/ |
... | @@ -84,7 +85,7 @@ See [Issue #46 Converter Service](https://community.opengroup.org/osdu/platform/ |
|
- `Audit and Metric`
|
|
- `Audit and Metric`
|
|
- `EDS`(External Data Services)
|
|
- `EDS`(External Data Services)
|
|
* The very first release of EDS.
|
|
* The very first release of EDS.
|
|
* Available in Azure environment only.
|
|
* Available in Azure environment only. (other CSPs to follow later)
|
|
* EDS allows connection to the data providers (OSDU external source environment), fetch the data and ingest it into the operator OSDU environment.
|
|
* EDS allows connection to the data providers (OSDU external source environment), fetch the data and ingest it into the operator OSDU environment.
|
|
* This release offers two capabilities.
|
|
* This release offers two capabilities.
|
|
- **Registration Process** - This functionality enables the registration (persistence) of configuration information needed for automated services to orchestrate Fetch and Ingestion workflows between a consuming OSDU Data Platform and OSDU compliant data sources.
|
|
- **Registration Process** - This functionality enables the registration (persistence) of configuration information needed for automated services to orchestrate Fetch and Ingestion workflows between a consuming OSDU Data Platform and OSDU compliant data sources.
|
... | @@ -179,5 +180,5 @@ See [Issue #15 Converter Service](https://community.opengroup.org/osdu/platform/ |
... | @@ -179,5 +180,5 @@ See [Issue #15 Converter Service](https://community.opengroup.org/osdu/platform/ |
|
)
|
|
)
|
|
* [Problem with Trajectory data type - recent change for schema 1.1.0](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/issues/61
|
|
* [Problem with Trajectory data type - recent change for schema 1.1.0](https://community.opengroup.org/osdu/platform/data-flow/ingestion/energistics/witsml-parser/-/issues/61
|
|
)
|
|
)
|
|
* `LAS loader for wellbore DDMS`
|
|
* `LAS loader for Wellbore DDMS`
|
|
* Known issue: Broken due to change in schema structure. [See issue.](https://community.opengroup.org/osdu/platform/data-flow/data-loading/wellbore-ddms-data-loader/-/issues/53) |
|
* Known issue: Broken due to change in schema structure. [See issue.](https://community.opengroup.org/osdu/platform/data-flow/data-loading/wellbore-ddms-data-loader/-/issues/53) |
|
|
|
\ No newline at end of file |