The remote FF and Rewind functions are weird. On my remote, you have a choice of a regular fast forward or what I call the "blip forward" in which it is supposed to jump a full minute forward. However, on the "blip", it does not jump to the next point; it gets there, but you have to watch it go by (fast) the whole time. If I hit the blip button 3 times in succession, it will go 3 minutes ahead.
If you look on your screen, you will see little breaks in the timeline of the recorded movie or show. If you hit the regular FF key immediately followed by the blip key, it will jump to the next one of those line breaks. Keep hitting the blip key, and it will keep jumping to the next break. Works the same way in reverse. That is how you're probably getting all the way to the end without intending to do so.
Thanks! I did not know that!