Loading of 50,000 records using Osdu_ingest DAG for IBM platform - job did not finish was left running for more than 48 hours
The job submitted to ingest 50000 records did not complete after letting it run for more than 48 hours. Looking at the airflow log it appeared to be saving the records, but it did not return status of finished, failed, or success. It always returned status of running and one could see the airflow log getting updated.