alt Hacker NewsI fine tuned an Ai model to be ethical a while back, had to derive a moral system that doesn't rely on consciousness or humanness to do it.
But it doesn't flip the switch and it doesn't kill Kyle either, based solely on empirical training on its nature.
Very cool. I don't do alignment research but I have to imagine we do need to train models to be ethical. It's not enough to guarantee safety though, especially with LLMs. For one thing, the fact they can hallucinate means if you ask an LLM something enough times, you will get the unlikely result some percentage of the time. So that unlikely result has to be one you can deal with.