Since they are the most vocal people that the average person hears calling themselves libertarian, their positions are all that less informed people now associate with the word.
Can you give me a good reason why we should let them re-define that term for us?