EDS Scheduler - validation error for Activity in eds_ingest

eds_ingest is failing due to
{src_dags_fetch_and_ingest.py:216} ERROR - Unexpected error in main file: 1 validation error for Activity

image

When eds_scheduler runs it appends execution_date to its run_id and triggers eds_ingest DAG. When eds_ingest DAG creates Activity Log id in this case it is - opendes:work-product-component--Activity:25-05-15T15:42:00+00:00.

However, this ID does not conform to the expected regex pattern: - ^[\\w\\-\\.]+:work-product-component\\-\\-Activity:[\\w\\-\\.\\:\\%]+$ This mismatch occurs due to validation rules applied to the Activity fields, causing the eds_ingest DAG to fail.

eds_scheduler_issue

cc- @ango2 , @teoshengpu, @AshishSaxenaAccenture

Edited May 19, 2025 by Sudesh Tagadpallewar
Assignee Loading
Time tracking Loading