logoalt Hacker News

mahouklast Sunday at 2:03 PM2 repliesview on HN

I wonder if the transformer inventors will ever get a Turing (honestly proving to be one of the most transformative - no pun intended - technologies of the millennium so far). I know pretty much all of them left Google but they'd still be counted as alumni.


Replies

Chu4eenolast Monday at 11:27 AM

Google's transformer paper was largely just stripping out parts of an earlier (now apparently largely forgotten) paper/model and running it on Google scale compute and data (which the original researchers obviously couldn't afford).

show 1 reply
wwind123last Sunday at 7:45 PM

Yeah, some work from Google has had an outsize impact on the entire industry. Won't be surprising if they eventually get a nod from the Turing Award. Including the main authors of the Transformer work for driving the LLM revolution, and Jeff Dean and Sanjay Ghemawat for driving the big data movement.