If they’re too dim to see, we don’t know at all what’s out there. For instance, what if, at the time of the Big Bang, there was a large mass of material that “escaped” the gravity of the mass that surrounds us, and is now pulling us out toward them. That would mean they’re accelerating us. That would be slowing them down, while still accelerating us. This would all be happening beyond our ability to see them because they are too far away and too dim to see.
Not in all directions. The red shift is every planet out there, going away from us at excessive accelerations.