ConnectedSourceDatajob - the problem is that there is no provision of "on ingest" schema authority
Here are the properties to guide "ingest" of fetched record on target.
- OnIngestionAcl
- OnIngestionLegalTags
- OnIngestionPartitionID
- OnIngestionDataPartitionID
Suggest renaming OnIngestionPartitionID to OnIngestionSchemaAuthority
So for Azure/R3M13/Preship environment, the tester will need to set the values as OnIngestionSchemaAuthority = osdu (this is shared Schema source, for all partitions) OnIngestionDataPartitionID = opendes (name of partition)
Also, this will need suitable adjustment of fetch-and-ingest code.