A lot of these features aren't that much work to build. Plugins is Toolformer, you basically tell the model what to emit and then the rest is fairly straightforward plumbing of the sort many coders can do, probably GPT-4 can do a lot of it as well. What is a lot of work and what AI can't do is lining up the partners, QAing the results etc, so the humans are likely working mostly on that.
Also I think it's easy to under-estimate how obvious a lot of this stuff was in advance. They were training GPT-4 last year and the idea of giving it plugins would surely have occurred to them years ago. The enabler here is really the taming of it into chat form and the fine-tuning stuff, not really the specific feature itself.
Also I think it's easy to under-estimate how obvious a lot of this stuff was in advance. They were training GPT-4 last year and the idea of giving it plugins would surely have occurred to them years ago. The enabler here is really the taming of it into chat form and the fine-tuning stuff, not really the specific feature itself.