logoalt Hacker News

fwipsy • yesterday at 2:36 AM • 1 reply • view on HN

> a way to scan the model weights for backdoors

The AI safety folks have been working on a way to verify model behavior more generally. The term I've heard is "mechanistic interpretability" and it's actually really hard, though there's been some progress.


Replies

pixl97 • yesterday at 1:44 PM

Unfortunately the big labs have been working the other way with more efficient models coming up with more and more neuralese.