Yes that was my goal. Also noticed a huge performance gain going from ollama to ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

sourc3 63 days ago | parent | context | favorite | on: Running local models on an M4 with 24GB memory

Yes that was my goal. Also noticed a huge performance gain going from ollama to mlx. Your mileage may vary.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact