My brother and I certainly did. Every kid in the neighborhood did the same, and everyone played together, whether friends or otherwise.
A drainage ditch split the neighborhood, with 20 yards on each side of the ditch. We had dirt clod battles, one side against the other.
Dirt clods and a drainage ditch, true gifts for boys, about as good a playground as boys can get.