Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Register
  • Sign in
  • O osdu-airflow-lib
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Merge requests 2
    • Merge requests 2
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Insights
    • Issue
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Open Subsurface Data Universe SoftwareOpen Subsurface Data Universe Software
  • Platform
  • Data Flow
  • Data IngestionData Ingestion
  • osdu-airflow-lib
  • Merge requests
  • !36

correction in schema kind authority for manifest by reference

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Devdatta Santra requested to merge Authority_Fix_for_Manifest_By_Ref into master Oct 20, 2022
  • Overview 4
  • Commits 3
  • Pipelines 2
  • Changes 2

Type of change

  • Bug Fix
  • Feature

Does this introduce a change in the core logic?

  • [Yes]

Does this introduce a change in the cloud provider implementation, if so which cloud?

  • AWS
  • Azure
  • GCP
  • IBM

Updates description?

This is related to issue -ingestion-dags#108 (closed)

Encountered an error - "Schema is not present" from Dataset service while running the manifest by reference DAG

After analysis we observed there are few codes where the 'Kind' of the schema is constructed with data-partition-id (which is 'opendes' in our case). But the schema which is present in our DB, there the 'Kind' actually starts with 'authority' (which is 'osdu' in our case). Hence the error.

So code changes done so that this value is fetched from a new DAG environment variable named "kind_authority" instead of 'data-partition-id'.

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: Authority_Fix_for_Manifest_By_Ref