I never remember my dreams, to the point that I am not convinced I actually have dreams. I sleep well, wake up refreshed most mornings, but have no recollection of having dreamt. Probably all the caffeine...
By now I'm pretty sure that during a large period of my life I almost didn't dream. I dreamt perhaps once a month, and usually in clusters of a few days. Nowadays, I dream very often, almost every night. I also wake up more often during the night. Unless my brain rewired significantly, I think the conclusion that I simply didn't dream back then is quite likely.
I also don't remember my dreams at all. This is the way it's supposed to be for us.
If you remember your dream it means you were woken up in the middle of it. Something is disrupting your sleep whether it's the brain itself or something else. The waking up in the middle of the night thing could be sleep apnea.
For people like us we're not suppose to remember dreams. But if we do, it means our sleep was disrupted.