alt Hacker NewsI don’t think the skill set required to write the Vaswani paper is the same as training and shipping frontier models like Gemini so I am not sure why people keep bringing this up.
I don’t think the skill set required to write the Vaswani paper is the same as training and shipping frontier models like Gemini so I am not sure why people keep bringing this up.
Training, tweaking and shipping frontier models like Gemini is something that a team of mediocre engineers can do.
Google continuing to ship generations of Gemini using its mediocre teams is an existence proof of that
For genuine advances one needs the Hintons and Vasvanis, not yet another bunch of mediocre Kookaid drinking product managers at Apple and Google