logoalt Hacker News

HAL3000 • yesterday at 9:54 PM • 2 replies • view on HN

This implies that weights are a type of language. Neural networks are good at language because they are good at patterns. They can reason about it because their "reasoning" isn’t how we think. The same goes for how they encode images, their vision is entirely different from ours. That's why adversarial attacks work on them and not on us. We don't see anything change in the image, while the neural network now sees that the dog is a cat.


Replies

jgilias • yesterday at 10:00 PM

Ok? But does that mean that the “weights language” is universal? E.g. same weight patterns mean the same thing regardless of if it’s Kimi, Grok, or Astra?

➕ show 1 reply
cout • yesterday at 10:29 PM

How do we (or can we) know adversarial attacks don't work on us?

➕ show 2 replies