Yeah, there's some large-scale mind-fuckery going on throughout the course of the story... and it makes sense in the general context. The reasons some remember and some forget are addressed, and yes, we see how this affects people, and the implicit horror both in forgetting, and in remembering.

It's a hell of a book.