Skip to content
GitLab
  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in / Register
  • I Ingestion DAGs
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 34
    • Issues 34
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages & Registries
    • Packages & Registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Insights
    • Issue
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Open Subsurface Data Universe Software
  • Platform
  • Data Flow
  • Data Ingestion
  • Ingestion DAGs
  • Merge requests
  • !64

GONRG-2913: Added support for whitelist reference patterns to exclude from...

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Aleksandr Spivakov (EPAM) requested to merge GONRG-2913_whitelist_reference_patterns_feature into master Aug 09, 2021
  • Overview 6
  • Commits 1
  • Pipelines 4
  • Changes 1

Type of change

  • Bug Fix
  • Feature

Does this introduce a change in the core logic?

  • [Yes]

Does this introduce a change in the cloud provider implementation, if so which cloud?

  • AWS
  • Azure
  • GCP
  • IBM

Updates description?

Introduces availability to whitelist references using custom regexp patterns to exclude those references from referential integrity validation.

New Airflow variable example:

image

See related MR for more details: osdu/platform/system/sdks/common-python-sdk!22 (merged)

closes osdu/platform/data-flow/ingestion/external-data-sources/external-data-framework#180 (closed)

Edited Aug 09, 2021 by Siarhei Khaletski (EPAM)
Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: GONRG-2913_whitelist_reference_patterns_feature