Perhaps you should check their "growth" over the last four elections.
That was my point, how would you like something which is annoying like the Libertarians, but which actually grows?