What you are talking about are two different things: memories, and sense of time. Most things aside humans, as much as I'm aware of, live in the here and now. So 5 minutes and 5 hours do not make a difference when waiting for something that is NOT here NOW.

Alas, humans are different. And thus we suffer.