One of Sally's children was named Madison Hemings. In 1870 he was living in Ohio. The census taker wrote in the margin next to his name: "This man is the son of Thomas Jefferson." Obviously that's what Madison had told him.
In the 1830 census, Sally Hemming and her two sons, living near Charlottesville, were listed as white.