Explore projects

Airflow DAGs that consume Source Registry configuration to handle the fetch and ingest orchestration.

The CSV Parser is a key component of pddms-csv-parser time-series bulk data ingestion workflow and main processing unit of corresponding Apache Airflow DAG

Production DDMS documentation and tutorials

The File Service provides internal and external APIs to request for file location data, such as a signed URL per file upload. Using the signed URL, OSDU users will be able to upload their files for ingestion into the system.

Docs: https://osdu.pages.opengroup.org/platform/system/file

[In development]

The Indexer Service indexes the metadata store to support the Search Service.

Docs: https://osdu.pages.opengroup.org/platform/system/indexer-service

A common place for shared CI/CD Pipeline files, for use with all OSDU Platform projects.

The Dataset Service provides internal and external APIs to allow fetching storage/retrieval instructions for various types of datasets.

Docs: https://osdu.pages.opengroup.org/platform/system/dataset

Schema (and Reference Value) Upgrade Service

Docs: https://osdu.pages.opengroup.org/platform/system/reference/schema-upgrade

The Schema Service enables schema management in the OSDU and offers an implementation of the schema standard.

Docs: https://osdu.pages.opengroup.org/platform/system/schema-service

The project contains all Airflow dependencies need to OSDU.

Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/osdu-airflow-lib

Secret Service facilitates the storage and retrieval of various types of secrets in a specified repository(ies) so that secrets can be secured, separated from the secrets in the infrastructure repository, and managed easily by interfacing applications.

Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/secret

Open Subsurface Data Universe (OSDU) Wellbore-DDMS Worker is a python back-end service used internally by the OSDU Wellbore DDMS. It provides an internal API for accessing Wellbore bulk data.

The CRS Conversion Service provides spatial reference conversions for coordinates. Coordinates are represented by an array of 3D points.

The Unit Service provides dimension/measurement and unit definitions. Given two unit definitions, the service also offers conversion parameters in two different parameterizations.

The CRS Catalog Service enables end-users to make CRS selections, search for CRSs given a number of constraints, download of the entire catalog for local caching, and access to various sub-sets of the catalog.