I believe he did do this on purpose. Way to go CJ Roberts.
Your belief is wrong. Unless of course you also believe that before the oath was administered again, correctly, later that day, Chief Justice Roberts resolved the issue of his citizenship.