Internal heating within the Earth comes from the gravity compression from formation of the planet plus radioactive decay of Potassium, Uranium, and Thorium. It will continue for many millenia. More info here: http://www.sciencedaily.com/releases/2003/12/031215072752.htm
That was very interesting, thank you!