Hacker News new | past | comments | ask | show | jobs | submit login

Fun fact: Nvidia H200 are currently half the price/hr of H100 bc people can’t get vLLM to work on it.

https://x.com/nisten/status/1871325538335486049




That is GH200 and it is likely due to an amd64 dependency in vLLM.


That seems like a CPU problem, not a GPU problem (due to Aarch64 replacing x86-64).




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: