Neuron voting power is not factored into how your neuron will vote. For example, if you follow one neuron with 1,000 ICP staked that votes "yes" and two other neurons with 50 and 20 ICP staked that both vote "no," your neuron will also vote "no."
Updated