You know the diabolical system would incorporate a facial recognition device, or fingerprint, etc., with no time lag so you can switch people in the middle of it.
There has been great science fiction written on this future dystopia by William Gibson.
There would be a new black market business where you go to visit, and they create portable holograms of your face, fingertips, eyes, whatever that you can give to others to use so the snooping tech thinks it is “you”.
Friends can mix and match the “fakes” for whatever purposes they wish.
In the dystopia it is used by corporations to maintain secrecy and criminals for obvious reasons.