Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in / Register
  • D Documentation
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 27
    • Issues 27
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Insights
    • Issue
    • Repository
  • Wiki
    • Wiki
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Open Subsurface Data Universe SoftwareOpen Subsurface Data Universe Software
  • Documentation
  • Issues
  • #67
Closed
Open
Issue created Mar 23, 2020 by Ferris Argyle@fargyleMaintainer1 of 5 checklist items completed1/5 checklist items

Ingestion - move createRecord into File Service instead of OSDU DAG

The intent is to expose this more transparently to ISVs and get them thinking in terms of file record.

  • AWS sees an issue with requiring with ISVs having to provide FileIDs, though this is optional

Status

  • Proposed
  • Trialing
  • Under review
  • Approved
  • Retired

Context & Scope

OSDU DAG

In future, when have Event-based model, may be able to turn Ingestion steps around since assured that file already exists when creating record.

Decision

Rationale

Consequences

When to revisit


Tradeoff Analysis - Input to decision

Alternatives and implications

Moving create record out of the DAG:

  • System still should create records for WP/WPC. If this logic is moved into the service, we don't need DAG anymore

Leaving create record in the DAG:

  • Future-proof for extending the logic (extra indexers, etc.)

Decision criteria and tradeoffs

Decision timeline

Edited Mar 27, 2020 by Vlad Korniev
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information
Assignee
Assign to
Time tracking