Projects with this topic
-
The Indexer Queue Service provides a set of APIs that help in forwarding the messages to and from the Storage Service and Indexer Service.
Docs: https://osdu.pages.opengroup.org/platform/system/indexer-queue
Updated -
This CSV Parser DAG supports the ingestion workflow for CSV type files
Updated -
The Register Service manages subscriptions, action and DDMS registrations in the OSDU.
Docs: https://osdu.pages.opengroup.org/platform/system/register
Updated -
The Storage Service handles metadata ingestion in OSDU.
Docs: https://osdu.pages.opengroup.org/platform/system/storage
Updated -
The Indexer Service indexes the metadata store to support the Search Service.
Docs: https://osdu.pages.opengroup.org/platform/system/indexer-service
Updated -
The Search Service supports full-text search on string fields, range queries on date, numeric or string fields, along with geo-spatial search.
Docs: https://osdu.pages.opengroup.org/platform/system/search-service
Updated -
The Geospatial Consumption Zone (GCZ) is a project spawned by the OSDU Geomatics Workstream to streamline the management and consumption of geospatial data in OSDU by client applications.
Updated -
The Schema Service enables schema management in the OSDU and offers an implementation of the schema standard.
Docs: https://osdu.pages.opengroup.org/platform/system/schema-service
Updated -
The Partition Service dynamically pulls the correct connection information at runtime to connect to the correct partition.
Docs: https://osdu.pages.opengroup.org/platform/system/partition
Updated -
The Notification service allows interested consumers to subscribe to data and metadata changes using a publish/subscriber pattern.
Docs: https://osdu.pages.opengroup.org/platform/system/notification
Updated -
Legal service is to help ensure data compliance with legal data governance when dealing with data in the Data Ecosystem by managing legal tags
Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/legal
Updated -
The Unit Service provides dimension/measurement and unit definitions. Given two unit definitions, the service also offers conversion parameters in two different parameterizations.
Updated -
The File Service provides internal and external APIs to request for file location data, such as a signed URL per file upload. Using the signed URL, OSDU users will be able to upload their files for ingestion into the system.
Updated -
Entitlements service is used to enable authorization in OSDU Data Ecosystem. The service allows for the creation and management of groups.
Docs: https://osdu.pages.opengroup.org/platform/security-and-compliance/entitlements
Updated -
The External Data Sources Data Management Service (EDS DMS) integrates with the Dataset Service to accept and proxy requests for obtaining retrieval instructions for externally resing datasets and proxy. The service is implemented in Java and provides an open API.
Updated -
The Dataset Service provides internal and external APIs to allow fetching storage/retrieval instructions for various types of datasets.
Docs: https://osdu.pages.opengroup.org/platform/system/dataset
Updated -
The CRS Catalog Service enables end-users to make CRS selections, search for CRSs given a number of constraints, download of the entire catalog for local caching, and access to various sub-sets of the catalog.
Updated -
The CRS Conversion Service provides spatial reference conversions for coordinates. Coordinates are represented by an array of 3D points.
Updated -
Schema (and Reference Value) Upgrade Service
Docs: https://osdu.pages.opengroup.org/platform/system/reference/schema-upgrade
Updated -
The Ingestion Workflow service provides a wrapper functionality around the Apache Airflow functions and is designed to carry out preliminary work with files before running the Airflow Directed Acyclic Graphs (DAGs) that will perform actual ingestion of OSDU data.
Docs: https://osdu.pages.opengroup.org/platform/data-flow/ingestion/ingestion-workflow
Updated