We can look back 4 billion years. It's a matter of finding things that are 4 billion light years away from us, and they can be spotted by looking for objects that appear with a specific redshift. But we aren't 4 billion light years away. Someone who is that far away can see what you're talking about, just as you can see them as they were 4 billion years ago.
But we aren't 4 billion light years awayWell, assuming an expanding universe (and a red shift basically proves that point) we SHOULD be able to see "ourselves" somewhere between the speed of light and the speed of expansion.
And if not (which I believe to be the case) then why do we see 11B (or 15B as the limit currently is) light years back in time?