Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Are they a lot better than 3.5? I see wildly varying opinions.


Mistral-Medium, the one announced here which beats GPT-3.5 on every benchmark, isn't even available yet. Those opinions are referencing Mistral-Tiny (aka Mistral-7B).

However, Mistral-Tiny beats the latest GPT-3.5 in human ratings on the chatbot-arena-leaderboard, in the form of OpenHermes-2.5-Mistral-7B.

Mixtral 8x7B aka (Mistral-Small) was released a couple of days ago and will likely come close to GPT-4, and well above GPT-3.5, on the leaderboards once it has gone through some finetuning.


They could be.

It is an open question whether the driving force will be OSS improving or OAI continuing to try to distill their model.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: