One doesn’t need knowledge and intellect to persuade other justices to a particular point of view when one has the Justices’ FBI file and tax records.
My guess would be an IRS visit. The can make you a criminal when you aren’t one.