I believe the AI labs might actually succeed in developing superintelligent AI and recursive self improvement, and that if they do they are very likely to lose control of the system they build.

I really think the only place people disagree is that they don't actually think it's possible, they see it as hype or doomerism. I can't find any good reasons to rule out that the companies could actually achieve what they are trying to so I think they should be stopped.

Humans have one ecological niche. Soon we will have zero. That is worth worry.

Misuse of extremely capable models, misalignment during RL are both very large risks as capabilities grow imo

i feel bad for math guys yeah seems they are more cooked than CS