I got about 7 tokens/sec generation on an M2 max macbook running 8-bit quant on ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

someguydave 4 months ago | parent | context | favorite | on: Qwen3.6-27B: Flagship-Level Coding in a 27B Dense ...

I got about 7 tokens/sec generation on an M2 max macbook running 8-bit quant on an MLX version.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact