So if you move to a community and find you are the only Jew, you’re out of luck? Maybe you need to work on your theory a bit.
That is in fact a problem if we take a local view of the First Amendment through the incorporation clause.
The First Amendment says “Congress”
That means that entire states were disposed toward one state religion or another such as Anglican or Catholic. So yes, you would only have your individual rights and not a collective right like those who were in the established religion.
It is what the amendment said and it certainly does not protect made up religions.
I do think obviously Judaism has an established history but frankly combined with the assembly right at the end of the First Amendment the founders probably thought people should be able to join into groups.