Both are fine schools. VMI just has a larger publicity machine than Norwich.
check the average temperature for december for Vt and Va. Chose accordingly.
That said, as a 20 year Army veteran, I have seen graduates of both institutions. VMI evokes George Marshall and Stonewall Jackson. Norwich evokes, well, the stay behind crew in South Boston from “Good Will Hunting”.