It's NOT like AF-1 was sitting on the ramp with it's engines turning. It would probably take 30 minutes for it to get ready for take off so his sitting there with the children for a few more minutes made no difference at all.
Not only that, there were things going on behind the scenes to get things and the country moving.