Integrate notification service to trigger DAG automatically
As of today, the ingestion DAGs are triggered manually. With the notification service in place, and the design pattern aligned on OSDU platform events, the DAG trigger could be done automatically in code by subscribing to certain events. This should improve the overall the ingestion workflow.
OSDU Platform Events: https://community.opengroup.org/osdu/platform/system/notification/-/wikis/OSDU-Platform-Events