Oh and is that really too young? One of my horse books says 8 but they start at 4 around here.
My son was 8 when he took lessons, I was riding by myself at 4 or 5. The last horse show we went to, one of the little girls was 5yr old, riding a full size horse in a walk, trot, trail class. A lot depends on the child.