hard coded legal tag in data-flow/ingestion/osdu-airflow-lib - execution workaround, is not a proper solution
We've just tested "Ingestion by reference" in M23 Pre-shipping.
The original manifest (https://community.opengroup.org/osdu/pre-shipping/-/blame/main/R3-M23/AWS-M23/Manifest%20Ingestion%20DAG/ManifestTest_2records.json?ref_type=heads#L14) uses "osdu-demo-legaltag" as the default tag for both, the file and both record_ids contained within.
We changed the legal tag and the record_id for the manifest and submitted. It worked well and ingested without issues. I checked for "osdu-demo-legaltag" and it did exist in the environment:
NOTE: the user_context is maintained (though it is difficult to know for certain as the user account we use to perform the pre-shipping testing is the admin-main@testing.com).
Then I removed the legal "osdu-demo-legaltag" from the environment and repeated the ingestion with the same manifest.
Failed with the same error whilst trying to upload and validate the manifest. So we tested the other workaround, adding the legal tag to the execution context:
Issue opened: osdu/platform/data-flow/ingestion/osdu-airflow-lib#12