Why people don't treat categorizing model activations as a science is beyond me.
Mechanistic interpretability is a field that studies exactly this.
Are you saying no one is trying to do exactly that?
Please, go on. How would you do it, specifically?
Mechanistic interpretability is a field that studies exactly this.