If I remember right he was advised to be an architect, since his technical drawing and painting skills were found wanting. He always had a keen interest in architecture all the way through his plans for a new Berlin, but I guess he rejected architecture as a profession.
Explains his fondness for Albert Speer.