Explore projects

The indexer services, indexes the metadata store to support search

A quick setup to launch an instance of Airflow using a Docker image.

Azure Infrastructure provisioning scripts and templates

The OSDU R2 Prototype includes a Workflow Engine, an implementation of Apache Airflow, to orchestrate business processes. In particular, the Workflow Engine handles ingestion of opaque and well log .las files in OSDU R2.

The Ingestion Workflow service provides a wrapper functionality around the Apache Airflow functions and is designed to carry out preliminary work with files before running the Airflow Directed Acyclic Graphs (DAGs) that will perform actual ingestion of OSDU data.

Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/ingestion-workflow

ETP client implemented in Java that connects to an ETP server using web sockets and produces data to Kafka topic