Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Register
  • Sign in
  • I Ingestion DAGs
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 31
    • Issues 31
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Merge requests 1
    • Merge requests 1
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Package Registry
    • Container Registry
    • Infrastructure Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Insights
    • Issue
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • Open Subsurface Data Universe SoftwareOpen Subsurface Data Universe Software
  • Platform
  • Data Flow
  • Data IngestionData Ingestion
  • Ingestion DAGs
  • Issues
  • #31
Closed
Open
Issue created Feb 05, 2021 by Kishore Battula@kibattulReporter

Validate entire manifest entity instead of Data inside the manifest entity

Currently in the schema validation logic below

def _validate_entity(self, entity: dict, schema: dict = None):
        """
        Validate the 'data' field of any entity against a schema got by entity's kind.
        """
        if not schema:
            schema = self.get_schema(entity["kind"])
        data = entity["data"]
        try:
            self._validate_against_schema(schema, data)
            logger.debug(f"Record successfully validated")
            return True
        except exceptions.ValidationError as exc:
            logger.error("Schema validation error. Data field.")
            logger.error(f"Manifest kind: {entity['kind']}")
            logger.error(f"Error: {exc}")
            return False

Only the data in a masterData/referenceData/Wp/Wpc is validate. Instead, the whole masterData/referenceData/Wp/Wpc must be validated. This validation will conform to the schemas uploaded in schema service.

Edited Feb 05, 2021 by Kishore Battula
Assignee
Assign to
Time tracking