logoalt Hacker News

radladyesterday at 12:34 PM4 repliesview on HN

> What makes this build different is the word before FP8: uncensored. We applied abliteration — orthogonalizing the refusal direction out of the residual stream — to remove the model's safety-alignment refusals. The result is a model that will comply with requests the original would refuse.

Surely this has unintended side effects on output quality?


Replies

andsoitisyesterday at 12:47 PM

> > What makes this build different is the word before FP8: uncensored. We applied abliteration — orthogonalizing the refusal direction out of the residual stream — to remove the model's safety-alignment refusals. The result is a model that will comply with requests the original would refuse.

> Surely this has unintended side effects on output quality?

Can you help me understand why that's the case?

show 1 reply
DiabloD3yesterday at 12:47 PM

It does depending on the technique.

timmmmmmayyesterday at 3:10 PM

Early attempts at this sort of thing definitely did, but these days the impact is minimal

miroljubyesterday at 12:47 PM

A bit worse quality is a fine trade off when the alternative is no output (zero quality).

show 1 reply