I’m not so sure about that. I do suspect that if the horse existed it was much smaller than typically depicted and only contained one or two men, enough to open the gates - or throw lines down to their friends to allow them to come in and open the gates.
Vergil mentions nine men by name - more are implied.