Hacker News new | past | comments | ask | show | jobs | submit login

Nvidia was forced to do that because it was so early, they had no customers except PhDs. I see no evidence AMD wants to do that right now, and instead focusing on extracting value from deep pocket enterprise customers.

The way things go, I think the AMD consumer card experience will only get better once AMD manage to gimp consumer cards’ ML throughput or RAM.




If you ask ML engineers now 100% will have started on desktop cards. Trying to squeeze the most money out of everyone just makes the ecosystem fail.

Look at IBM, they sell technologies that no one uses until they get hired to work on them specifically. It's profitable enough but it's not a way to grow the ecosystem/market.


I think you are preaching to the choir, and AMD is not listening.

AMD would be selling 48GB 7900s or AI-only W7900s if they really wanted a consumer card ramp.

They don't. Not because they can't (they literally prevent OEMs from doing so, who would double up VRAM in a heartbeat without AMD lifting a finger), but because AMD doesn't want that.


> The way things go, I think the AMD consumer card experience will only get better once AMD manage to gimp consumer cards’ ML throughput or RAM.

Que? Making things worse will make things better?


They'll let you do some things on a consumer card as soon as they can make sure that you can't effectively use the consumer card in place of an enterprise card.


so, artificial market segmentation?

...that's exactly how you get disruptive competition.


It's worth noting this is a game nvidia has already been playing for a long time by intentionally limiting the performance of higher precision floating point operations on consumer cards.


[flagged]


Nvidia has their own market segmentation tactics, like a 24GB 4090 is $2,000 and the 48GB version is $7,000.


Why not buy 2x24GB cards and use SLI with CUDA? Or does that represent a bottleneck-so-bad that it's a dealkiller and worth the $3000 premium?


Llama.cpp wasn't optimized for multi GPU setups. You need to split individual layers onto the GPU instead of simple offloading.


SLI no longer exists.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: