The Chief Justice administering the oath is traditional, not required. Calvin Coolidge was sworn in by a Notary Public.
Merd! Yep. I just reread Article II, Section 1, Para 8. It simple says "...he shall take the following oath...". Does not say who administers it.