Training, tweaking and shipping frontier models like Gemini is something that a team of mediocre engineers can do.
Google continuing to ship generations of Gemini using its mediocre teams is an existence proof of that
For genuine advances one needs the Hintons and Vasvanis, not yet another bunch of mediocre Kookaid drinking product managers at Apple and Google