What you are discovering is your brain supplementing the signal in a vain attempt to give it meaning.
It's a guess.
You must learn to overcome that.
He had a regular guest who would record people then play the recordings back in reverse resulting in some eerie situations.
There was one instance where the fellow's infant son came into the living room baby-talking while a shed outside soon caught fire.
The guy played the baby talk backwards after he told us that played backwards the child was saying, “the shed is on fire!”
Sure enough,that is what it “sounded like” the kid said. Of course if he didn't tell me what it sounded like I may never have figured it out.