Explore projects

A collection of GitLab scripts.

These are mostly one-off scripts, designed to solve a particular problem I'm having at the moment. I try to generalize them slightly. If nothing else, they serve as a template for how to do scripting.

The Schema Service enables schema management in the OSDU and offers an implementation of the schema standard.

Airflow DAGs that consume Source Registry configuration to handle the fetch and ingest orchestration.

The OSDU R2 Prototype includes a Workflow Engine, an implementation of Apache Airflow, to orchestrate business processes. In particular, the Workflow Engine handles ingestion of opaque and well log .las files in OSDU R2.

OSM (Object to KV-Store) Mapper

OQM (Object to Queue) Mapper

OBM (Object to Blob) Mapper

Legacy contribution from Energistics - only supports WITSML v2.0

The Manifest Ingestion DAG includes a Workflow Engine, an implementation of Apache Airflow, to orchestrate manifest/metadata ingestion via Storage Service

Airflow DAG for transformation from SEGY to OpenVDS

Azure Infrastructure provisioning scripts and templates

The Search Service supports full-text search on string fields, range queries on date, numeric or string fields, along with geo-spatial search.

The Entity Management Service provides a set of APIs that enables the user to register OSDU Storage records as entities in Production DDMS, put them into relationships (hierarchies) and discover existing entities based on search criteria. Entities are defined through a type like well, meter, valve or platform. Two entities can have multiple entity relationships of a different types. The entities can be retrieved from the system in graph format with upward or downward graph traversal.

This is the repository for automated QA tests done on the OSDU Data Platform for each milestone release with real-world datasets (TNO, Volve, etc.)

[In development]

OBM (Object to Blob) Mapper