>On pure research they invented the transformer in 2017 (Vaswani) Transformers w... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

logicchains on Oct 28, 2023 | parent | context | favorite | on: Google to invest up to $2B in Anthropic

>On pure research they invented the transformer in 2017 (Vaswani)

Transformers were invented in the early 90s: https://people.idsia.ch/~juergen/fast-weight-programmer-1991... Google were just the first with the compute to scale them up.

blovescoffee on Oct 28, 2023 [–]

fwiw Schmidhuber is famous for claiming to have come up with virtually every architecture that's now useful/important.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact