You can vote at any time before your followee has voted. However, once your followee has voted, you cannot override the followee's vote. This is to maintain the following structure for possible followers of your neuron, as well as the wait-for-quiet logic.
Updated