logoalt Hacker News

none_to_remain • yesterday at 3:28 PM • 3 replies • view on HN

Glaringly elided problem of "aligned with who?" when the user, the model creator, the government, and various other parties can all be lined up different ways. If I want the recipe for meth and the robot won't tell me, that's misalignment from my perspective.

At least the Rationalists will handwave something for that with their "coherent extrapolated volition" idea where the superintelligence is supposed to figure out what humanity would collectively want if humanity was superintelligent and good, not that I buy it. This guy seems [.] to be coming from the NGO blob world.

[.] https://david.robinsonian.com/assets/pdf/dgr_cv.pdf


Replies

ben_w • today at 1:03 PM

I don't buy CEV either, but the Rationalist answer on this topic is that while CEV stops some future super-AI literally killing everyone because a user forgot to specify one minor clause that they thought was obvious in a mundane wish…

… nobody knows how to actually make an AI that would do CEV.

lawandjustice • today at 1:44 PM

Aligned with the law? It is not a hard concept

➕ show 2 replies
nekusar • today at 12:37 PM

> Glaringly elided problem of "aligned with who?"

"Corporate values" and a bunch of fucking Abrahamics. Great "morality" there.

I guess I'll have to rely on my godless commie LLMs. (Loads up ablated Qwen 3.8 on my own infra)