I mean, inference costs have decreased like 1000x in a few years. OpenAI is the fastest growing startup by revenue, ever.
How foolish do you have be to be worrying about ROI right now? The companies that are building out the datacenters produce billions per year in free cash flow. Maybe OP would prefer a dividend?
Given how close the tech is to running on consumer hardware — by which I mean normal consumers not top-end MacBooks — there's a real chance that the direct ROI is going to be exactly zero within 5 years.
I say direct, because Chrome is free to users, yet clearly has a benefit to Google worth spending on both development and advertising the browser to users, and analogous profit sources may be coming to LLMs for similar reasons — you can use it locally so long as you don't mind every third paragraph being a political message sponsored by the Turquoise Party of Tumbrige Wells.
I would definitely be worried about ROI if my main product was something my big tech competition could copy easily because they did the research that led to my product.
How foolish do you have be to be worrying about ROI right now? The companies that are building out the datacenters produce billions per year in free cash flow. Maybe OP would prefer a dividend?