Yes, it definitely looks like a public building of some sort. The gathering seems to be a family or two, plus the Regulators gang.
I’ve got that same board-&-batten siding on my house and outbuildings.
Never did learn to play no croquet.