Walls won't solve it... but a 'smart' minefield would.
Hell, I have never seen the man yet who could climb over a 60 foot smooth faced wall.