I seemed to recall they were in the Lincoln White House, but had forgotten even this much.
It was after little Thad died --- the second child she had lost to illness. Mary went a little crazy after that and I guess you would have to be a pretty hard person to not allow her her grief.
There have been far worse thing happen in the White House than seances.