They have an excellent LLM called Claude which is quite competitive with OpenAI offerings and has long context windows.
Other than OpenAI’s models they have been able to deliver the best results in projects I worked on and sometimes they outperformed OpenAI models too.
I’m happy to see this as this gives them funding to further train expensive models and compete - their product is really nice at the moment but could really benefit from bigger size and even bigger contexts.
They have Claude 2 which is up there with GPT-4 and PaLM 2 as one of the top three publicly accessible large language models. And presumably those billions will train Claude 3.
I'm sorry but I'll have to disagree with you - Claude 2 is worse than GPT-4 in almost all tasks I've tried it with, the two things that it's better at than GPT-4 are the context window and the dataset being from early 2023 instead of late 2021 (for 3.5 Turbo/4).
Being worse than GPT-4 doesn't dispute GP's claim that it's in the top 3 with GPT-4. To disagree with them you need to name models other than GPT-4 and PaLM 2 which are also better than Claude 2.
I’m still trying to get my mind around a world where Brain/DeepMind aren’t way ahead on all this. They were so far ahead so recently.
Is there a comeback story here? IIRC they’ve still got Dean and Hassabis and a bunch of other bruisers, along with arbitrary financing, the best training sets, and novel compute.
Is it time to put Hassabis in charge and start making Ilya and Karpathy offers they can’t refuse?
Sure, they're all competing labs, but Deepmind isn't a competitor for a product offering. Anthropic is quite analogous to OpenAI because they have an API you can pay for an a chatbot product you can use.