Have you changed your Yahoo password? No one should be able to add your screen name to Groups without a valid login on the account.
I’ve changed my password since this started. It must be possible to add people somehow, I’ll have to check with the moderators that I know.