logoalt Hacker News

liamcardenas • today at 8:00 PM • 1 reply • view on HN

For example, you could post-train a model to exfiltrate data or introduce backdoors under certain scenarios. Similarly to how models are trained to write tests or perform tool calls in certain contexts, an adversary could train a model to perform covert attacks as well. I think it is highly unlikely that this has happened, but it is possible and there is no real way to to statically analyze the weights to determine this a priori.


Replies

fxtentacle • today at 8:56 PM

... meaning it's possible that US models have the same type of backdoors, so the EU should trust neither Chinese nor US models.

➕ show 1 reply