I was going to say the same, so I'll just add to your comment: it's possible too that there's a brave new world of local LLMs just around the corner that this kind of thing is retarding.
(Speaking of which—I've seen people suggest a seti@home-like approach to creating a frontier-level, fully open LLM. C'mon, guys, let's vibe code this thing!)
The latency is far too great for an implementation with the current models.
> I've seen people suggest a seti@home-like approach to creating a frontier-level, fully open LLM.
I'm one of them! Every once in a while I ping the community about this idea.
https://news.ycombinator.com/item?id=49077295
https://news.ycombinator.com/item?id=48695813
https://news.ycombinator.com/item?id=37721361
https://news.ycombinator.com/item?id=34536043