My fear is that they'll end up fighting us and each other.
Could very well happen. Civil wars are downright ugly.
That's why it is important to clearly articulate your principles, and the ongoing effects of policies that would be based on those principles, and let the sides gravitate to where they will.
Labels won't mean much with forty different flavors each of D, R, and libertarians.