Why do so few vote libertarian, in a country largely founded on the principle of personal liberty?

Many political differences are able to be reduced to a question of more personal liberty vs less. It seems a significant number of those at the left and right ends of the political spectrum have more in common than they may realize, and logically should be conceptualized along Individualistic (Libertarian or Conservative "less government", personal responsibility, fewer rules, suspicion of power seeking ) vs Socialistic/Fascist (good of the group, lots of rules and tinkering, messianistic leaders, blame and solution based politics) lines. Those who promote gun control have more in common with those who wish to abolish abortion than those who would decriminalize drugs. Likewise, people who favor unrestricted religious activity wherever the urge may strike have more in common with ographers than censors.