Explore projects

The Time-series Publisher Core (or internal) Service is a part of time-series ingestion pipeline. Processes ingestion messaging queue and prepares data for Time-series Storage Core Service.

The Time-series Storage Core (or internal) Service is a final step in time-series ingestion pipeline. Processes published ingestion messages and stores data to the Time-series Storage.

Time-series Query Core (or internal) Service provides low level APIs for fetching data streams from Time-series Store.

The Ingestion Workflow service provides a wrapper functionality around the Apache Airflow functions and is designed to carry out preliminary work with files before running the Airflow Directed Acyclic Graphs (DAGs) that will perform actual ingestion of OSDU data.

Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/ingestion-workflow

The External Data Sources Data Management Service (EDS DMS) integrates with the Dataset Service to accept and proxy requests for obtaining retrieval instructions for externally resing datasets and proxy. The service is implemented in Java and provides an open API.

The Time-series Service provides functionality for fetching stored time-series by entity, property, source and date-time span. The time-series are handled in a bi-temporal approach, where the version time is the time where the fact has been stored and the physical time where the transaction has happened.

Typescript client for open-etp-server, including REST API

SDFS - low-level pythonic fsspec implementation for SDMS

SDFS_UTIL - SDFS-based alternative for sdutil

The project contains all Airflow dependencies need to OSDU.

Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/osdu-airflow-lib

The CRS Conversion Service provides spatial reference conversions for coordinates. Coordinates are represented by an array of 3D points.

The Register Service manages subscriptions, action and DDMS registrations in the OSDU.

Docs: https://osdu.pages.opengroup.org/platform/system/register

This is sdapi (C++ library) for seismic dms also known as SDMS v3

A common place for shared CI/CD Pipeline files, for use with all OSDU Platform projects.

Secret Service facilitates the storage and retrieval of various types of secrets in a specified repository(ies) so that secrets can be secured, separated from the secrets in the infrastructure repository, and managed easily by interfacing applications.

Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/secret

The Notification service allows interested consumers to subscribe to data and metadata changes using a publish/subscriber pattern.

Docs: https://osdu.pages.opengroup.org/platform/system/notification

Airflow DAGs that consume Source Registry configuration to handle the fetch and ingest orchestration.