So far as I know CPUSA membership was never illegal. There were several requirements to disclose membership that were repeatedly challenged. I believe it was eventually declared unconstitutional but I’m not sure.
It was illegal to work for the government if advocating the overthrow of the government.
There is a certain elegance to this idea, if you stop and think about it. Clinton Rescinded those XOs, I’m not making this stuff up.