The girls are raised by nannies (per Heidi) and they seldom see Ted (per Heidi. Ted has always lived in another CITY from his wife and daughters.) Not sure when there's time for Ted to spank.
They don’t know who he is. One of them even referred to him as a “guest” when he stays at home.