File metadata not added
WorkProductComponent Dataset records are loaded into storage, but this is not done through the File service files/metadata endpoint and so the associated files are never copied from Staging to Persistant areas. Looking at the code save_record_to_file_service() in osdu_ingestion\libs\process_manifest_r3.py never seems to be called.
Is this by design and if so what should the ingestion process be? As is it might imply that if we need to upload files this should be done outside of the manifest using the File API and use that reference in the WorkProductComponent rather than including seperate Dataset records.