That assumes all images went out in a straight line - which they do, in essence from an object, but the rotation of the Earth would screw up your reference point (air waves give a shimmer, gravity can bend or so I’ve heard).
As you said, only brief glimpses could be seen - cloud cover notwithstanding or any space-traveling object, that on the most slim chance crossed the path, obscuring the view.
I liked the response Marilyn vos Savant gave - if the universe is endless (given), and star light travels incredible distances, why is it that the heavens don’t appear to be nearly one bright, constant light.
Because the others are so very, very, very distant, the light hasn’t been able to get to us yet. Even though some has traveled incredible distances. I remind myself that the Sunlight you see (or accidentally see the star itself while driving - hopefully dodging looking directly) is in fact, roughly 5 minutes old itself. You’re looking at history when you move the visor to block out looking directly at the Sun.
I didn’t know that about the sun!!!
Oops and the orbit of the Earth. And the movement of the solar system and the galaxy. I’m sure there were other things. Like the Moon might get in the way, sometimes, depending upon angles, LOL.
Aaaaaaaaaaaaaiiiiiiiiiiieeeee!!