That may have just been that teacher's experience.
Second, young kids do not sit in on IEPs. The only time the children sit in on IEPs is when they are transitioning out of high school.
That could vary in different locations.
I'm on a list serve with hundreds of parents of special needs children in other schools across the nation, and none of us would dream of taking our children into an IEP meeting until they are older.