I think they just don’t want him around anyway. The combined scandals and his actions just made him the dumpster fire relative you don’t want around the house.
I think the spy issue is just icing on another crap cake.
I think you are right. Andrew has stepped on his “Johnson” so many times he needs to disappear from public view. Maybe like Edward VII they should send him to be governor of Bermuda for a while until people forget about him.