Agree; and again, think it incumbent, in an imperfect world; that these people figure out safer, less overt and confrontational appearances per where 'otherwise'; they would not belong. Legalities, not enough; IMHO.
Maybe the best solution, considering the numerous permutations of gender that have evolved in the last few decades, would be for all public establishments to have only private unisex restrooms, one room per occupant. More expensive to be sure, but in the long run cheaper than settling lawsuits.