This is a question that analysts don't even ask on earnings calls for companies with lowly earthbound datacenters full of the same GPUs.
The stock moves based on the same promise that's already unchecked without this new "in space" suffix:
We'll build datacenters using money we don't have yet, fill them with GPUs we haven't secured or even sourced, power them with infrastructure that can't be built in the promised time, and profit on their inference time over an ever-increasing (on paper) lifespan.
My cynical take is that it'll works out just fine for the data centers, but the neighbouring communities won't care for the constant rolling blackouts.
Okay but even in that case the hardware suffers significant under utilisation which massively hits RoI. (I think I read they only achieve 30% utilisation in this scenario)
That article appears to be stuck behind a paywall, so I can't speak to it.
That's good for now, but considering the federal push to prevent states from creating AI regulations, and the overall technological oligopoly we have going on, I wonder if, in the near future, their energy requirements might get prioritized. Again, cynical. Possibly making up scenarios. I'm just concerned when more and more centers pop up in communities with less protections.
Not really. GPUs are stateless so your bounded lifetime regardless of how much you use them is the lifetime of the shitties capacitor on there (essentially). Modulo a design defect or manufacturing defect, I’d expect a usable lifetime of at least 10 years, well beyond the manufacturer’s desire to support the drivers for it (ie the sw should “fail” first).
The silicon itself does wear out. Dopant migration or something, I'm not an expert. Three years is probably too low but they do die. GPUs dying during training runs was a major engineering problem that had to be tackled to build LLMs.
> GPUs dying during training runs was a major engineering problem that had to be tackled to build LLMs.
The scale there is a little bit different. If you're training an LLM with 10,000 tightly-coupled GPUs where one failure could kill the entire job, then your mean time to failure drops by that factor of 10,000. What is a trivial risk in a single-GPU home setup would become a daily occurrence at that scale.
The stock moves based on the same promise that's already unchecked without this new "in space" suffix:
We'll build datacenters using money we don't have yet, fill them with GPUs we haven't secured or even sourced, power them with infrastructure that can't be built in the promised time, and profit on their inference time over an ever-increasing (on paper) lifespan.