All initiation of force is a violation of someone else's rights, whether initiated by an individual or the state for the benefit of an individual or group of individuals, even if it's supposed to be for the benefit of another individual or group of individuals.
I like Mitt Romney as a person. I think he's a dignified person. But I have no common ground on economics. He doesn't worry about the Federal Reserve. He doesn't worry about foreign policy. He doesn't talk about civil liberties so I would have a hard time to expect him to ever invite me to campaign with him.