Just curious...but doesn't memory also have to do with time? ......point A. to B. and most measurable things require the memory to discern time.
Aristotle used counting (1,2,3...) as an illustration of time. And it seems reasonable to me that we remember events, e.g. each step in the counting, in a serial/sequential order.
Indeed, we never actually perceive in the present because there is a tiny time lag between sensory perception and cognition of it.