> (GPT2 -> GPT3 -> GPT4) have meant significant improvements

These were all train the same way. It's fairly clear that o1 was not.

> Maybe we will have to wait for GPT5 for that :)

There will be no GPT5, for the simple reason that scaling has reached a limit and there is no more text data to train on.