Explore projects

Python SDK that encapsulates calls to the Core Services.

This is the repository for automated QA tests done on the OSDU Data Platform for each milestone release with real-world datasets (TNO, Volve, etc.)

The Dataset Service provides internal and external APIs to allow fetching storage/retrieval instructions for various types of datasets.

Docs: https://osdu.pages.opengroup.org/platform/system/dataset

The Storage Service handles metadata ingestion in OSDU.

Docs: https://osdu.pages.opengroup.org/platform/system/storage

The Search Service supports full-text search on string fields, range queries on date, numeric or string fields, along with geo-spatial search.

Docs: https://osdu.pages.opengroup.org/platform/system/search-service

This project provides Java client libraries for using OSDU core services.

Google Cloud Infrastructure provisioning scripts and templates.

The File Service provides internal APIs to request for file location data through Dataset Service, such as a signed URL per file upload. Using the signed URL, OSDU users will be able to upload their files for ingestion into the system.

Docs: https://osdu.pages.opengroup.org/platform/system/file

The CRS Conversion Service provides spatial reference conversions for coordinates. Coordinates are represented by an array of 3D points.

The CSV Parser is a key component of pddms-csv-parser time-series bulk data ingestion workflow and main processing unit of corresponding Apache Airflow DAG

OBM (Object to Blob) Mapper

The Time-series Service provides functionality for fetching stored time-series by entity, property, source and date-time span. The time-series are handled in a bi-temporal approach, where the version time is the time where the fact has been stored and the physical time where the transaction has happened.

Time-series Query Core (or internal) Service provides low level APIs for fetching data streams from Time-series Store.

The Time-series Storage Core (or internal) Service is a final step in time-series ingestion pipeline. Processes published ingestion messages and stores data to the Time-series Storage.

The Time-series Publisher Core (or internal) Service is a part of time-series ingestion pipeline. Processes ingestion messaging queue and prepares data for Time-series Storage Core Service.

The Time-series Management Service allows users to ingest time-series bulk data as a array of data points. The data can be written for set of entities, properties and source. User access is restricted through entitlements. The data ingested supports bi-temporality.