Do believe that majority equates to moral authority?

If a majority of people in a certain geographic area vote in a certain way should this negate the rights of people who do not vote that way? If so, why?