They always have and will for the foreseeable future, as will Anthropic and other labs which manage to ascend to the frontier, pretty much by definition. It’s exactly the same with hardware vendors - by the time you can buy the product, the lab is working on something you’ll want to buy a few years from then.
Nice in theory in practice you always retain them locally as well, just in case the network connection goes down.
If network egress fails and logs are pushed in real time over a connection with no local backing, you face an ugly tradeoff: either drop log data silently (loss of visibility during the very network partition you need to debug) or apply backpressure to services (potentially hanging applications when logging buffers saturate).
I think the same exact model running on CPU-only and RAM, or a small GPU, would do about the same? It's quite an old model now and small, you could throw a GGUF into llama-server or something for a side by side comparison.
As I remember just about any english language model from mid 2024 and earlier didn't even do well if you asked it to count sequentially from 0 to 100, nevermind calculating stuff.
Weirdly, normally new ChatGPT releases are head and shoulders above anything else, but according to OpenAI's own evaluation, Anthropic's Mythos outperforms ChatGPT in quite a few benchmarks: https://openai.com/index/gpt-5-6/.
ChatGPT 6 must be deep in the pipeline and will be released within the next few months. Maybe that's why this release is versioned 5.6, not 6.0.
I think its more about branding than anything else. Anthropic played a masterstroke with the way they marketed, released, and then blocked Mythos. Now everyone know the Mythos "model" by name.
ChatGPT 6 is trying to follow suite.
OpenAI already has a model that is at the very least twice as smart as Astra.
Oh god.
reply