Think about time travel.
If I'm planning to go back to 10,000 b.c then I'm scientifically and realistically going into the past. But for my mind and my experience, I'm ALWAYS travelling forward in time. And don't remember everything in the scientific order, but in the order in which I experienced it, which is, the future before the past.
So?