That's right! The Bill Of Rights doesn't give any rights at all. It merely expresses pre-existing rights. You already have those rights and others, it just lists some of them for the benefit of those who would take them away.
That's actually a Libertarian sentiment (and some other "conservative" philosophies as well) but it isn't at all compatible with "state's rights" philosophies which insist that each state can decide any and all questions including state religions, slavery, segregation, bedroom privileges, etc.
Libertarians (and as I say some others) believe that rights pre-exist any government whereas Constitutionalists believe whatever the Constitution says, however amended. That's precisely why Libertarians aren't strict Constitutionalists -- since an amended or interpreted Constitution could take away your right to bear arms. Libertarians believe you have an innate right of the means of self-defense, including those tools that can accomplish that goal, such as handguns -- and therefore no government, no Constitution, no anything can rightly infringe that right.
We Libertarians are often called scoff-laws for such principled stands -- as anti-societarian, etc.