Hacker News new | past | comments | ask | show | jobs | submit login

The likely architecture of GPT-4 was invented at Google - MoE. OpenAI poached the team who developed it.

OpenAI is ahead on the RL data side. To me that’s the likely biggest advantage they have in GPT-4.




Wouldn’t Google be able to catch up easily if that was really OpenAI’s only advantage? Google has a lot more resources to throw at RL. It seems like there must be some other secret sauce for OpenAI to continue maintaining such a huge lead.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: