Don’t ruin something as wonderful as robot umpires by giving dumb human umpires discretion over whether challenges are called quickly enough.

Easy fix. Batter is still in the box and pitch clock for the next pitch has not started, they should be able to challenge.