Thank you, for the reality check! :) | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		accrual on Nov 19, 2024 \| parent \| context \| favorite \| on: Llama 3.1 405B now runs at 969 tokens/s on Cerebra... Thank you, for the reality check! :)

thomashop on Nov 19, 2024 [–]

We have moved 2 orders of magnitude in the last year. Not that unreasonable

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact