fix localhost access regression in dual-stack API server startup (#67370)

https://github.com/apache/airflow/commit/29510e45cd3aee7df5ba0ed32424d3e1f4f003c3