I wonder if the same technique can be applied to model abliteration? It would easily make any open weight models uncensored.
It is already the same technique behind abliteration: identifying the direction associated with an observed behavior (refusal, for abliteration) and projecting it out.
alt Hacker News
It is already the same technique behind abliteration: identifying the direction associated with an observed behavior (refusal, for abliteration) and projecting it out.