It's just the effect of the plastic surgery he had in the mid 60s when they had to make him look like the real Paul McCartney.
The Walrus is Paul.