G

Graduated

The Manifest Ingestion DAG includes a Workflow Engine, an implementation of Apache Airflow, to orchestrate manifest/metadata ingestion via Storage Service

Schema (and Reference Value) Upgrade Service

Docs: https://osdu.pages.opengroup.org/platform/system/reference/schema-upgrade

The Ingestion Workflow service provides a wrapper functionality around the Apache Airflow functions and is designed to carry out preliminary work with files before running the Airflow Directed Acyclic Graphs (DAGs) that will perform actual ingestion of OSDU data.

Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/ingestion-workflow

This CSV Parser DAG supports the ingestion workflow for CSV type files

The File Service provides internal and external APIs to request for file location data, such as a signed URL per file upload. Using the signed URL, OSDU users will be able to upload their files for ingestion into the system.

Docs: https://osdu.pages.opengroup.org/platform/system/file

The Notification service allows interested consumers to subscribe to data and metadata changes using a publish/subscriber pattern.

Docs: https://osdu.pages.opengroup.org/platform/system/notification

The Dataset Service provides internal and external APIs to allow fetching storage/retrieval instructions for various types of datasets.

Docs: https://osdu.pages.opengroup.org/platform/system/dataset

The External Data Sources Data Management Service (EDS DMS) integrates with the Dataset Service to accept and proxy requests for obtaining retrieval instructions for externally resing datasets and proxy. The service is implemented in Java and provides an open API.

The Register Service manages subscriptions, action and DDMS registrations in the OSDU.

Docs: https://osdu.pages.opengroup.org/platform/system/register

The Unit Service provides dimension/measurement and unit definitions. Given two unit definitions, the service also offers conversion parameters in two different parameterizations.

The CRS Conversion Service provides spatial reference conversions for coordinates. Coordinates are represented by an array of 3D points.

The Geospatial Consumption Zone (GCZ) is a project spawned by the OSDU Geomatics Workstream to streamline the management and consumption of geospatial data in OSDU by client applications.

Airflow DAG for transformation from SEGY to OpenVDS

Entitlements service is used to enable authorization in OSDU Data Ecosystem. The service allows for the creation and management of groups.

Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/entitlements

Policy service is used for management and evaluation of dynamic policies in OSDU.

Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/policy

The CRS Catalog Service enables end-users to make CRS selections, search for CRSs given a number of constraints, download of the entire catalog for local caching, and access to various sub-sets of the catalog.

The Indexer Queue Service provides a set of APIs that help in forwarding the messages to and from the Storage Service and Indexer Service.

Docs: https://osdu.pages.opengroup.org/platform/system/indexer-queue

Airflow DAG for transformation from SEGY to OpenZGY

The Schema Service enables schema management in the OSDU and offers an implementation of the schema standard.

Docs: https://osdu.pages.opengroup.org/platform/system/schema-service

The Partition Service dynamically pulls the correct connection information at runtime to connect to the correct partition.

Docs: https://osdu.pages.opengroup.org/platform/system/partition