|
|
# Release Plan for R3:
|
|
|
The goal is to be able to release the Core, Extensions, Domains, Domain Data Flows and Layered Services as described under [Projects](R3 Projects) independently. It should be possible to release each of the domain DDMS or domain data flows or layered services as and when they are ready on top of the R3 core. This requires prioritization and focus on projects 1 (Core) and 2 (Data flow and Reference/Helper services) first in R3 to establish this hub and spoke model for effective parallel development and delivery. Therefore these two projects are scheduled for immediate delivery in R3.
|
|
|
|
|
|
The goal is to be able to release the Core, Extensions, Domains, Domain Data Flows and Layered Services as described under [Projects](R3 Projects) independently. It should be possible to release each of the domain DDMS as and when they are ready on top of the R3 core. Likewise improvements to the extensions around ingestion, enrichment, helper services can be released incrementally as well when R3 core is done.
|
|
|
The immediate priority is therefore to get the R3 codebase populated (see [Initial Steps](R3Initial%7CR3-Initial-Steps) ) and to get the core changes described under here and to keep the Core stable and reliable for further development and delivery of Extension Projects and Domain Projects.
|
|
|
|
|
|
The priority is therefore to get the R3 codebase populated (see [Initial Steps](R3Initial%7CR3-Initial-Steps) ) and to get the core changes described under here and to keep the Core stable and reliable for further development and delivery of Extension Projects and Domain Projects.
|
|
|
*Note: *The requirements in this page for the R3 scope were distilled from the various backlogs in [Program Activities](https://community.opengroup.org/osdu/program) ( in particular [Shared Backlog](https://community.opengroup.org/osdu/program/-/wikis/Release_Planning/R3/Shared_Backlog)) and from OpenDES pending contributions moved to R3.
|
|
|
|
|
|
# Engagement model:
|
|
|
|
|
|
As the scope for the OSDU platform expands as mentioned above to domains and extensions it is important that we keep agility in the system and provide a reliable core that projects under extensions and domains can use to work in parallel. This [list](Engagement model) describes the principles that will be used in R3 timeframe to ensure agility, governance and transparency in the platform development.
|
|
|
|
|
|
# Definition of Done:
|
|
|
Please review [Definition of Done](https://community.opengroup.org/osdu/platform/home/-/wikis/Planning/R3/Done) to understand when we can consider R3 deliverables for scope below as completed
|
|
|
|
|
|
# Scope for R3 for Core Projects:
|
|
|
|
|
|
1. [System](https://community.opengroup.org/osdu/platform/system)
|
|
|
- Maintain R2 [OSDU Libs](https://community.opengroup.org/osdu/platform/system/lib) & core Services (search, [Storage](https://community.opengroup.org/osdu/platform/system/storage), ...) from <span style="color: orange;">CSP</span>
|
|
|
- Data change Notifications from <span style="color:blue">SLB</span>
|
|
|
- [Schema](https://community.opengroup.org/osdu/platform/system/schema-service) service from <span style="color:blue">SLB</span>
|
|
|
- DDMS enablement services - Registry and lookup from <span style="color:blue">SLB</span>
|
|
|
- Move [File service](https://community.opengroup.org/osdu/platform/system/file) as DDMS from <span style="color:orange">CSP</span>
|
|
|
- Data quality atttributes from *TBD*
|
|
|
- Delete and privileged purge in [Storage Service](https://community.opengroup.org/osdu/platform/system/storage), ...)
|
|
|
from *TBD*
|
|
|
|
|
|
2. Search & Indexer
|
|
|
- Hierarchical/nested array of objects support in Indexer and [Search](https://community.opengroup.org/osdu/platform/system/search-service) service from <span style="color:orange">CSP</span> team
|
|
|
- Upgrade Elastic client version in Indexer
|
|
|
- Spatial index service* beyond R2 capabilities from *TBD*
|
|
|
|
|
|
|
|
|
3. [Reference and Helper Services](https://community.opengroup.org/osdu/platform/reference)
|
|
|
- [Units](https://community.opengroup.org/osdu/platform/reference/unit-service) catalog and conversion service from <span style="color:blue">SLB</span>
|
|
|
- [Coordinate catalogs](https://community.opengroup.org/osdu/platform/reference/crs-catalog-service) and [Coordinate conversion](https://community.opengroup.org/osdu/platform/reference/crs-conversion-service) services from <span style="color:blue">SLB</span>and using [Apache SIS](http://sis.apache.org/) project
|
|
|
- Elevation reference*
|
|
|
- Reference catalog and mapping services*
|
|
|
|
|
|
4. [Security and Compliance](https://community.opengroup.org/osdu/platform/security-and-compliance)
|
|
|
- Identity Integration*
|
|
|
- [Access control service](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements-service) from <span style="color:orange">CSP</span>
|
|
|
- [Compliance service](https://community.opengroup.org/osdu/platform/security-and-compliance/legal) from <span style="color:blue">SLB</span>
|
|
|
# Release 3 Backlog
|
|
|
- [**High Level R3 Epics/User Journeys**](https://community.opengroup.org/groups/osdu/platform/-/epics) - very early draft! incomplete.
|
|
|
- [**High Level R3 Backlog**](https://community.opengroup.org/groups/osdu/platform/-/boards/71)
|
|
|
- Capturing Backlog - Use [Issues](https://community.opengroup.org/osdu/platform/home/issues) to capture the backlog items & Use [Labels](https://community.opengroup.org/osdu/platform/home/-/labels) to categorize the issues for the boards
|
|
|
|
|
|
# Definition of Done:
|
|
|
- [Definition of Done](https://community.opengroup.org/osdu/platform/home/-/wikis/Planning/R3/Done) - R3 deliverables.
|
|
|
|
|
|
# Scope for R3 for Extension Projects:
|
|
|
|
|
|
5. [Data Flow](https://community.opengroup.org/osdu/platform/data-flow) - Ingestion & Enrichment
|
|
|
- [Ingestion Pipeline](https://community.opengroup.org/osdu/platform/data-flow/ingestion) with pluggable modules from <span style="color:orange">CSP</span>
|
|
|
- Parser and Validation modules*
|
|
|
- Generic formats parsers (CSV, ASCII, JSON, …)
|
|
|
- [Data Preparation](https://community.opengroup.org/osdu/platform/data-flow/data-prep) scripts
|
|
|
- Agent framework for job management
|
|
|
- register jobs (ingestion, enrichment), get notifications of completion/aborts, inspect logs
|
|
|
- [Enrichment Pipeline](https://community.opengroup.org/osdu/platform/data-flow/enrichment) with pluggable modules
|
|
|
- WKS support from <span style="color:blue">SLB</span>
|
|
|
### Release 3 Discussions
|
|
|
|
|
|
6. [Deployment and Operations](https://community.opengroup.org/osdu/platform/deployment-and-operations)
|
|
|
- Global deployment, multi-region support from <span style="color:orange">CSP</span>
|
|
|
- Operations focused services - logging, metering, audit trails for cyber-security from <span style="color:orange">CSP</span>
|
|
|
- Disaster recovery and business continuity from *TBD*
|
|
|
- [Architecture and Design](https://community.opengroup.org/osdu/platform/home/-/wikis/Planning/R3/Architecture) <BR /> These discussions focus on Architecture and Design Decisions specific to Release 3
|
|
|
|
|
|
14. Multi-OSDU federation (ala data marketplace support) from Chevron
|
|
|
# Top-level Scope for R3 for Core Project(1):
|
|
|
1. [System](https://community.opengroup.org/osdu/platform/system)
|
|
|
- Maintain R2 [OSDU Libs](https://community.opengroup.org/osdu/platform/system/lib) & core Services (search, [Storage](https://community.opengroup.org/osdu/platform/system/storage), ...) from <span style="color: orange;">CSP</span>
|
|
|
- Data change Notifications from <span style="color:blue">SLB</span>
|
|
|
- [Schema](https://community.opengroup.org/osdu/platform/system/schema-service) service from <span style="color:blue">SLB</span>
|
|
|
- DDMS enablement services - Registry and lookup from <span style="color:blue">SLB</span>
|
|
|
- Move [File service](https://community.opengroup.org/osdu/platform/system/file) as DDMS from <span style="color:orange">CSP</span>
|
|
|
- Data quality atttributes from *TBD*
|
|
|
- JSON Schema versioning
|
|
|
- Core common and CSPs libs versioning strategy
|
|
|
- Delete and privileged purge in [Storage Service](https://community.opengroup.org/osdu/platform/system/storage), ...)
|
|
|
from *TBD*
|
|
|
1. Search & Indexer
|
|
|
- Hierarchical/nested array of objects support in Indexer and [Search](https://community.opengroup.org/osdu/platform/system/search-service) service from <span style="color:orange">CSP</span> team
|
|
|
- Upgrade Elastic client version in Indexer
|
|
|
- Spatial index service* beyond R2 capabilities from *TBD*
|
|
|
1. [Security and Compliance](https://community.opengroup.org/osdu/platform/security-and-compliance)
|
|
|
- Identity Integration*
|
|
|
- [Access control service](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements-service) from <span style="color:orange">CSP</span>
|
|
|
- [Compliance service](https://community.opengroup.org/osdu/platform/security-and-compliance/legal) from <span style="color:blue">SLB</span> - Done!
|
|
|
1. [Deployment and Operations](https://community.opengroup.org/osdu/platform/deployment-and-operations)
|
|
|
- Global deployment, multi-region support from <span style="color:orange">CSP</span>
|
|
|
- Operations focused services - logging, metering, audit trails for cyber-security from <span style="color:orange">CSP</span>
|
|
|
- Disaster recovery and business continuity from *TBD*
|
|
|
- OSDU Contribution Guide(Project Structure, Apache License, Attribution, README..etc).
|
|
|
|
|
|
# Top-level Scope for R3 for Data Flow and Helpers Extension Project(2):
|
|
|
1. [Reference and Helper Services](https://community.opengroup.org/osdu/platform/reference)
|
|
|
- [Units](https://community.opengroup.org/osdu/platform/reference/unit-service) catalog and conversion service from <span style="color:blue">SLB</span>
|
|
|
- [Coordinate catalogs](https://community.opengroup.org/osdu/platform/reference/crs-catalog-service) and [Coordinate conversion](https://community.opengroup.org/osdu/platform/reference/crs-conversion-service) services from <span style="color:blue">SLB</span>and using [Apache SIS](http://sis.apache.org/) project
|
|
|
- Reference catalog and mapping services*
|
|
|
1. [Data Flow](https://community.opengroup.org/osdu/platform/data-flow) - Ingestion & Enrichment
|
|
|
- [Ingestion Pipeline](https://community.opengroup.org/osdu/platform/data-flow/ingestion) with pluggable modules from <span style="color:orange">CSP</span>
|
|
|
- Agent framework for job management
|
|
|
- register jobs (ingestion, enrichment), get notifications of completion/aborts, inspect logs
|
|
|
- [Enrichment Pipeline](https://community.opengroup.org/osdu/platform/data-flow/enrichment) with pluggable modules
|
|
|
- WKS support from <span style="color:blue">SLB</span>
|
|
|
|
|
|
# Scope for R3 for Domain Projects:
|
|
|
|
|
|
Domain projects are related to services, data models and technology capabilities related to specific domains.
|
|
|
[Domain Data Flow Services](): These are projects related to ingestion (parsers, pre/post processing) and enrichment of domain specific data formats and data types:
|
|
|
1. Generic Parser and Validation modules*
|
|
|
- Generic formats parsers (CSV, ASCII, JSON, …)
|
|
|
- [Data Preparation](https://community.opengroup.org/osdu/platform/data-flow/data-prep) scripts
|
|
|
1. Parsers and agents for standard formats (LAS, Energistics, ...) and repositories (PPDM, ...)*
|
|
|
- Energistics parsers from Energistics
|
|
|
|
|
|
[Domain Data Management Services](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services):
|
|
|
|
|
|
7. [Wellbore](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore) domain from <span style="color:blue">SLB</span>
|
|
|
|
|
|
8. [Seismic](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic) domain from Bluware, <span style="color:blue">SLB</span>
|
|
|
|
|
|
9. [Reservoir](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/reservoir) domain* from Energistics, Emerson
|
|
|
|
|
|
10. [Well Delivery](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/well-delivery)* from <span style="color:blue">SLB</span>
|
|
|
|
|
|
11. Real-time and streaming services* from *TBD*
|
|
|
|
|
|
Domain-Specific modules for Ingestion and Enrichment
|
|
|
|
|
|
12. Parsers and agents for standard formats (LAS, Energistics, ...) and repositories (PPDM, ...)*
|
|
|
- Energistics parsers from Energistics
|
|
|
|
|
|
13. Data connectors for external data sources*
|
|
|
- Pending* *TBD*
|
|
|
|
|
|
14. Non-functional requirements
|
|
|
- JSON Schema versioning
|
|
|
- Core common and CSPs libs versioning strategy
|
|
|
- OSDU Contribution Guide(Project Structure, Apache License, Attribution, README..etc). |
|
|
\ No newline at end of file |
|
|
1. [Wellbore](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/wellbore) domain from <span style="color:blue">SLB</span>
|
|
|
1. [Seismic](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/seismic) domain from Bluware, <span style="color:blue">SLB</span>
|
|
|
1. [Reservoir](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/reservoir) domain* from Energistics, Emerson
|
|
|
1. [Well Delivery](https://community.opengroup.org/osdu/platform/domain-data-mgmt-services/well-delivery)* from <span style="color:blue">SLB</span>
|
|
|
1. Real-time and streaming services* from *TBD*
|
|
|
|
|
|
# Scope for R3 for Layered Services Projects:
|
|
|
1. Data connectors for external data sources* from CVX
|
|
|
- Pending* *TBD*
|
|
|
1. Global OSDU index federation (ala regions support) from SDU |
|
|
\ No newline at end of file |