AWS M25: EDS Ingestion Failure: 'Source' Property Schema Validation Error with Valid Source Records

In AWS\M25 preship, while testing EDS Ingestion, my ingestion fails with the reason "Entity doesn't pass the schema validation." even though the source records are valid.

Find the relevant details for the run below:

  • CSRE: osdu:master-data--ConnectedSourceRegistryEntry:arpit-singh-gcp-m25
  • CSDJ: osdu:master-data--ConnectedSourceDataJob:arpit-singh-gcp-m25
  • Source Environment: GCP\M25 preship.
  • Source kind: Basin
  • Source record id:
    • "id": "m25:master-data--Basin:MichiganBasin_GCP"
    • "id": "m25:master-data--Basin:PermianBasin_GCP"
    • "id": "m25:master-data--Basin:AmazonBasin_GCP"
    • "id": "m25:master-data--Basin:TarimBasin_GCP"
  • EDS Ingestion run id: be8203fa-d04c-492c-ad5b-4535469333bb

My observations about the issue: In the logs of eds_ingest, I notice the payload being passed to Osdu_ingest contains 'Source': None for each record. Subsequently, Osdu_ingest fails the schema validation with the following messages in logs: Error: None is not of type 'string' Failed validating 'type' in schema['properties']['data']['allOf'][0]'properties']['Source']

My source records did not initially contain data.Source property as it is not required. However, even if I set data.Source to some value, the payload for Osdu_ingest still contains the null causing failure.

Edited by Arpit Singh