[Don't Merge][WIP] Try different approach to solve CI failure in #56351

https://github.com/apache/airflow/pull/57123