Not entirely true. I grew up in an America where we kids would be gone all day in the summertime, goofing around and riding our bikes or playing baseball and stopping at the store for comics and not coming home until we were hungry, or it was getting dark.
Big difference between infants and kids.