logoalt Hacker News

sailingparrot • yesterday at 4:33 PM • 1 reply • view on HN

It is absolutely not a thing in any practical sense that relates to detecting post-trained backdoors, no.

Or provide a source showing how to do this (and not just a circuit paper showing which activations light up with the word dog)


Replies

jacquesm • yesterday at 5:04 PM

> It is absolutely not a thing in any practical sense that relates to detecting post-trained backdoors, no.

> Or provide a source showing how to do this (and not just a circuit paper showing which activations light up with the word dog)

The fact that you're not informed does not place a burden on me.

https://www.crowdstrike.com/en-us/blog/crowdstrike-researche...

This is all just a sub-class of supply chain attacks.

You don't have to be able to explain every aspect of a model to be able to inspect for undesirable traits.

➕ show 1 reply