About 30 years ago I took a 2-week canoe trip along the border in NE Minnesota. Probably crossed the border 20 or 30 times.
Never once saw anybody resembling a border control person.
Your post is pretty much the same as mine...
Build the danged fence.