Explore projects

OSDU platform pre shipping activities

OSDU platform pre shipping activities

[In Development] Schema (and Reference Value) Upgrade Service

[Stable] The Register Service manages subscriptions, action and DDMS registrations in the OSDU.

[Stable] The Indexer Service indexes the metadata store to support the Search Service.

[Stable] The Workflow service provides a wrapper functionality around the Apache Airflow functions and is designed to carry out preliminary work with files before running the Airflow Directed Acyclic Graphs (DAGs) that will perform actual ingestion of OSDU data.

Contains the organization and governance material for PMC and associated projects.

[Stable] The Storage Service handles metadata ingestion in OSDU.

Google Cloud Infrastructure provisioning scripts and templates.

[Stable] The Notification service allows interested consumers to subscribe to data and metadata changes using a publish/subscriber pattern.

[Stable] The Indexer Queue Service provides a set of APIs that help in forwarding the messages to and from the Storage Service and Indexer Service.

[Stable] The Partition Service dynamically pulls the correct connection information at runtime to connect to the correct partition.

The OSDU R2 Prototype includes a Workflow Engine, an implementation of Apache Airflow, to orchestrate business processes. In particular, the Workflow Engine handles ingestion of opaque and well log .las files in OSDU R2.

[Early Release/Experimental] The External Data Sources Data Management Service (EDS DMS) integrates with the Dataset Service to accept and proxy requests for obtaining retrieval instructions for externally resing datasets and proxy. The service is implemented in Java and provides an open API.

[Early Release/Experimental] Services that consume Source Registry configuration to handle the fetch and ingest orchestration.

[Experimental] The project contains Airflow DAG Raster Ingestion that is outcome (ML POC) of EPAM team.