That's true. Attention can't be stored, and you can't really take a lot of time to decide what to do with it either. (Every amount of effort spent trying to optimize attention also spends attention).