Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in / Register
  • I Indexer
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 23
    • Issues 23
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Merge requests 21
    • Merge requests 21
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Insights
    • Issue
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Open Subsurface Data Universe SoftwareOpen Subsurface Data Universe Software
  • Platform
  • System
  • Indexer
  • Issues
  • #7
Closed
Open
Issue created Nov 16, 2020 by Gary Murphy@gtmurphyDeveloper

Indexer to read from Schema Service as well as Storage Schema -- non-breaking

The Indexer currently reads only from the Storage schema endpoint for schemas that describe storage records. As part of the Schema Service roadmap, Indexer needs to consume schemas from Schema Service as well as Storage. At this stage in the roadmap, Storage Schemas will not be migrated to the Schema Service, but Indexer will read from both endpoints.

The bulk of record ingestion is expected to be through ingestion services, and these will use the Schema Service schemas to describe records being ingested. So, as noted in the Schema Service roadmap, all consumers of schemas should eventually be using only the Schema Service as the SoR for storage record descriptions and tailoring those full-featured schemas to suit their consumption patterns. The interim step proposed here is that Indexer begin reading from Schema Service for schemas first (and internally flattening those schemas as needed for indexing), then checking for Storage Schemas for a kind's schema if not found in Schema Service. This approach necessitates an eventual migration of Storage Schemas to Schema Service at some point, but this is likely to be needed anyway, i.e. Schema Service as SoR drives that requirement. By not removing the Storage Service schema endpoint and having Indexer check both endpoints, a non-breaking enhancement is introduced that allows evolutionary introduction of Schema Service schemas to the indexing workflow.

Edited Nov 16, 2020 by Gary Murphy
Assignee
Assign to
Time tracking