Check this out.
http://memory.loc.gov/ammem/pihtml/pioaths.html
Kinda neat.
Calvin Coolidge was sworn in by his father, a Notary Public.
In a pinch, I guess the highest ranking person available gets to do the honors.
Wow. Chiej Justice John Marshall presided over nine ceremonies for five different presidents.