Clean up the exception handler when run_as_user is the airflow user

https://github.com/apache/airflow/pull/38726