To clarify, > Port of Hugging Face's Transformers library, using the tch-rs crat... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		MuffinFlavored on Feb 20, 2023 \| parent \| context \| favorite \| on: Running large language models like ChatGPT on a si... To clarify, > Port of Hugging Face's Transformers library, using the tch-rs crate and pre-processing from rust-tokenizers. > tch-rs: Rust bindings for the C++ api of PyTorch. Which "backend" does this end up using on Apple Silicon, MPS (Metal Performance Shaders) or OpenCL? https://pytorch.org/docs/stable/notes/mps.html I'm going to guess MPS?

smoldesu on Feb 20, 2023 [–]

Whatever your Pytorch install is designed to accelerate. I've got Ampere-accelerated Pytorch running it on my ARM server, I assume MPS is used on compatible systems.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact