The houses were not built specifically to deny him the right to his view from a boat. So, if he claims his fence was not built specifically to deny them a view to his lake (perhaps he built it for liability reasons), then by your argument he can continue. Right?
That's more reasonable -- and better PR on his part. This is all about being neighborly. But he mooted that by "demanding" $30K from each now, didn't he?