Oh, I just noticed the ability is being used, even though I selected 'no' on the prompt. So the issue isn't that the cooldown is activating, but that the ability is being used regardless of what you choose.