[Non-functional Requirements] Ingestion - Ability to run long-running jobs
Some of the Ingestion jobs can be long-running, Ingestion Framework should support such cases (Authentication aspect etc). Ingestion jobs should not be using a user token to run the jobs. Some Airflow token should be used for workflows running.
OpenDES supports such a scenario - up to 30d