alt Hacker NewsIs it actually that hard to make good models or is it just about the amount of resources you have to do training? (This is an actual question, I really don't know.) I'm sure it's not trivial but does it really take world class secret knowledge to build off of the known existing techniques? I feel like there's tons of low hanging fruit still to explore, and time and resources are the limiting factor.
Replies
Not hard to be a fast follower. Lots of companies are ~6-9 months behind. Reaching the actual bleeding edge is much harder.
>Is it actually that hard to make good models
Didn't take DeepSeek long. Or XAI to launch grok.
If they have a top team and the money then appears to be a matter of a year or two? And one startup mentioned is Japanese not Chinese so they won't be banned from buying US tech.
The gap between grok and Gemini to Claude and chatgpt suggests that yes it is that hard.