EDS DAGs do not work
**eds_scheduler **uses a lot of deprecated methods without normal output. It's difficult to understand is it okay or result is false positive.
[2023-04-11, 13:45:12 UTC] {dagbag.py:355} WARNING - Found __init__..py at root of /home/airflow/gcs/dags/eds/eds_scheduler.zip
[2023-04-11, 13:45:12 UTC] {dagbag.py:364} INFO - File /home/airflow/gcs/dags/eds/eds_scheduler.zip:__init__.py assumed to contain no DAGs. Skipping.
[2023-04-11, 13:45:12 UTC] {scheduler_trigger_dagrun.py:55} INFO - Connected Source Data Job Kind: osdu:wks:master-data--ConnectedSourceDataJob:1.3.0.
[2023-04-11, 13:45:12 UTC] {warnings.py:109} WARNING - /home/airflow/gcs/dags/eds/eds_scheduler.zip/eds_scheduler_dag.py:40: DeprecationWarning:provide_context is deprecated as of 2.0 and is no longer required
[2023-04-11, 13:45:13 UTC] {dagbag.py:355} WARNING - Found __init__..py at root of /home/airflow/gcs/dags/eds/eds_ingest.zip
[2023-04-11, 13:45:13 UTC] {warnings.py:109} WARNING - /home/airflow/gcs/dags/eds/eds_ingest.zip/src_dags_fetch_ingest_scheduler_dag.py:54: DeprecationWarning:provide_context is deprecated as of 2.0 and is no longer required
[2023-04-11, 13:45:13 UTC] {taskinstance.py:1279} INFO - Marking task as SUCCESS. dag_id=eds_scheduler, task_id=trigger_eds_ingest, execution_date=20230411T134000, start_date=20230411T134505, end_date=20230411T134513
[2023-04-11, 13:45:13 UTC] {local_task_job.py:154} INFO - Task exited with return code 0
eds_ingest is failed with 'list index out of range' error
2023-04-11, 08:46:42 UTC] {src_dags_fetch_and_ingest.py:549} INFO - Total Fetched Records: 0
[2023-04-11, 08:46:42 UTC] {src_dags_fetch_and_ingest.py:155} ERROR - {'status': 'error', 'message': IndexError('list index out of range')}
Traceback (most recent call last):
File "/home/airflow/gcs/dags/eds/eds_ingest.zip/libs/src_dags_fetch_and_ingest.py", line 97, in fetch_and_ingest
records = self._fetch_client(criteria_dict)
File "/home/airflow/gcs/dags/eds/eds_ingest.zip/libs/src_dags_fetch_and_ingest.py", line 552, in _fetch_client
logger.info(f"Displaying only one Sample Record : {records[0]}")
IndexError: list index out of range
[2023-04-11, 08:46:42 UTC] {xcom.py:447} ERROR - Could not serialize the XCom value into JSON. If you are using pickle instead of JSON for XCom, then you need to enable pickle support for XCom in your airflow config.
[2023-04-11, 08:46:42 UTC] {taskinstance.py:1776} ERROR - Task failed with exception
Edited by Denis Karpenok (EPAM)