Explore projects

The Geospatial Consumption Zone (GCZ) is a project spawned by the OSDU Geomatics Workstream to streamline the management and consumption of geospatial data in OSDU by client applications.

The Ingestion Workflow service provides a wrapper functionality around the Apache Airflow functions and is designed to carry out preliminary work with files before running the Airflow Directed Acyclic Graphs (DAGs) that will perform actual ingestion of OSDU data.

Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/ingestion-workflow

The Search Service supports full-text search on string fields, range queries on date, numeric or string fields, along with geo-spatial search.

Docs: https://osdu.pages.opengroup.org/platform/system/search-service

The Schema Service enables schema management in the OSDU and offers an implementation of the schema standard.

Docs: https://osdu.pages.opengroup.org/platform/system/schema-service

Schema (and Reference Value) Upgrade Service

Docs: https://osdu.pages.opengroup.org/platform/system/reference/schema-upgrade

The Storage Service handles metadata ingestion in OSDU.

Docs: https://osdu.pages.opengroup.org/platform/system/storage

[In development]

This CSV Parser DAG supports the ingestion workflow for CSV type files

The External Data Sources Data Management Service (EDS DMS) integrates with the Dataset Service to accept and proxy requests for obtaining retrieval instructions for externally resing datasets and proxy. The service is implemented in Java and provides an open API.

The CRS Conversion Service provides spatial reference conversions for coordinates. Coordinates are represented by an array of 3D points.

Legal service is to help ensure data compliance with legal data governance when dealing with data in the Data Ecosystem by managing legal tags

Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/legal

The Indexer Service indexes the metadata store to support the Search Service.

Docs: https://osdu.pages.opengroup.org/platform/system/indexer-service

The Register Service manages subscriptions, action and DDMS registrations in the OSDU.

Docs: https://osdu.pages.opengroup.org/platform/system/register

Entitlements service is used to enable authorization in OSDU Data Ecosystem. The service allows for the creation and management of groups.

Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/entitlements

OBM (Object to Blob) Mapper

OSM (Object to KV-Store) Mapper

OQM (Object to Queue) Mapper

This project provides Java client libraries for using OSDU core services.

The Dataset Service provides internal and external APIs to allow fetching storage/retrieval instructions for various types of datasets.

Docs: https://osdu.pages.opengroup.org/platform/system/dataset