Skip to content

Azure: Fix for Kubernetes pod operator for CSV parser not terminating

harshit aggarwal requested to merge exception-handling into azure/m14-master

This MR is adding a fix to resolve an issue in CSV parser where k8s pod are not terminating in case of exceptions The fix includes handling the run time exceptions thrown by core code and explicitly terminating the application with status code 1

Earlier the run time exceptions were directly thrown from main function which can result in any non zero error codes, perhaps causing the issue for pod operator to not terminate the pods correctly

This was tested by simulating multiple exceptions in csv parser code and making sure csv pods get terminated as excepted when launched by Airflow worker

Edited by harshit aggarwal

Merge request reports