No, it simply means that a loud-mouth minority of kooks from the far left & right are trying to drown out the decent folks from all walks of life who make up Paul's base of support.
If the "load-mouthed kooks" were drowning out his "base of support"...wouldn't that mean that his base is very quiet? Or, does that mean that his numbers are wrong and those voting for him are "loud-mouthed kooks"? Which is it??