[AIRFLOW-XXX] Raise ValueError rather than assert in skip logic (#5875)

https://github.com/apache/airflow/commit/aa8a30099884efbf6fd5fb276f3dc6a310866aba