> What makes this build different is the word before FP8: uncensored. We applied abliteration — orthogonalizing the refusal direction out of the residual stream — to remove the model's safety-alignment refusals. The result is a model that will comply with requests the original would refuse.
Surely this has unintended side effects on output quality?
It does depending on the technique.
Early attempts at this sort of thing definitely did, but these days the impact is minimal
A bit worse quality is a fine trade off when the alternative is no output (zero quality).
> > What makes this build different is the word before FP8: uncensored. We applied abliteration — orthogonalizing the refusal direction out of the residual stream — to remove the model's safety-alignment refusals. The result is a model that will comply with requests the original would refuse.
> Surely this has unintended side effects on output quality?
Can you help me understand why that's the case?