I seem to recall that part of the theme of that song was combining a number of different things that he had read in the newspaper, and one of the things he had read was about a survey of the number of potholes in the streets of Blackburn, London. The result was 4,000 potholes.
I may not be exactly right but its something like that.
Seems to me you are correct. It was potholes....