Skip to content

Draft: Fix for Kubernetes pod operator for CSV parser not terminating

harshit aggarwal requested to merge exception-handling into azure/m14-master

This MR is adding a fix to resolve an issue in CSV parser where k8s pod are not terminating in case of exceptions

The fix includes throwing a custom IngestionException instead of a generic throwable exception

The IngestionException object is implementing ExitCodeGenerator Interface and overriding exitCode() method to return status code 1 in case of exceptions, when throwing such exceptions, Spring Boot returns the exit code provided by the implemented getExitCode() method

This was tested by simulating multiple exceptions in csv parser code and making sure csv pods get terminated as excepted when launched by Airflow worker

Edited by harshit aggarwal

Merge request reports