alt Hacker NewsI personally have many problems with Meta, but imo the more companies close to the frontier, the better.
If only one company were calling all the shots once they hit recursive self-improvement, it would lead to extreme concentration of power, and their values being enforced across the entire industry. With 3-4 companies at the frontier, there is more urge to cooperate to avoid a catastrophic race condition.
Replies
You say this as if recursive self improvement is inevitable.
I generally agree with more competition thing, but in this case, you actually should want only one company to race ahead, and not a few.
With a few of these top companies together, you, as a nobody, has no one powerful on your side. But with only one company pretty far ahead, you now have other companies which obviously don't give a shit about you, but for saving their own asses, will align with you.
Both exploit, but "cartels" survive, not loners.
Especially given the most recent report by NYT on how Anthropic tried to create a new belief, or religion if you will, I'd rather the world has more frontier models that are neutral to morality (basic standards, like upholding the law and user agreement are necessary, of course).
I think it's unsettling that a bunch of billionaires hold so much power. Does it really matter if 2 or 3 billionaires who are practically neighbors hold so much power? It's extremely concentrated with or without Meta joining the race.
It will lead to an extreme concentration of power anyways, once a very few entities basically make labor obsolete.
We're heading for a dystopia and nobody's doing anything to stop it.
The more companies from different countries close to the frontier, the better.