Explore projects

This project creates a container with some scripts to support the trusted MR pattern, used in OSDU projects.

The Ingestion Workflow service provides a wrapper functionality around the Apache Airflow functions and is designed to carry out preliminary work with files before running the Airflow Directed Acyclic Graphs (DAGs) that will perform actual ingestion of OSDU data.

Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/ingestion-workflow

The Manifest Ingestion DAG includes a Workflow Engine, an implementation of Apache Airflow, to orchestrate manifest/metadata ingestion via Storage Service

The Storage service has three different categories of API's 1.Schemas 2.Records 3.Query for schema and record management.

The Register Service manages subscriptions, action and DDMS registrations in the OSDU.

Docs: https://osdu.pages.opengroup.org/platform/system/register

Google Cloud Infrastructure provisioning scripts and templates.

Azure Infrastructure provisioning scripts and templates

This project is to play with running services locally in docker but pointed to a valid Azure Environment Backend.

Legacy contribution from Energistics - only supports WITSML v2.0

Open ZGY contribution

This CSV Parser DAG supports the ingestion workflow for CSV type files

The Partition Service dynamically pulls the correct connection information at runtime to connect to the correct partition.

Docs: https://osdu.pages.opengroup.org/platform/system/partition

The Schema service supports the registration of new schemas describing "Kinds of data"

Azure Infrastructure provisioning scripts and templates

Azure Infrastructure provisioning scripts and templates