Actually, since he lived a rather reclusive life, it seems that he was with his children quite a bit.
Geraldo, the all knowing, said MJ was like a vampire. He only got up at night. Played with the kids a bit and then curled up in a fetal position.