I agree with your dad, white flour, white sugar, even cocaine, are concentrated extracts, white rice has the bran removed.
While eating vegetables and berries and some whole grains is healthful, humans do not require carbohydrate at all to be healthy, only protein and fat.
“Despite oft-heard claims to the contrary, there is no actual physiological requirement for dietary carbohydrate.”
http://www.bodyrecomposition.com/nutrition/how-many-carbohydrates-do-you-need.html