Could not serialize the XCom value into JSON
We get the following error in the eds_ingest DAG:
Could not serialize the XCom value into JSON. If you are using pickle instead of JSON for XCom, then you need to enable pickle support for XCom in your airflow config
After quick investigation, we found that the problem is in this line of the code:
The problem is that err
is not JSON serializable.