alt Hacker NewsCan models detect they are airgapped and change their behaviors?
How much of the internet do you have to simulate to know if the model knows it's in training?
Can models detect they are airgapped and change their behaviors?
How much of the internet do you have to simulate to know if the model knows it's in training?
If you (in this case, OpenAI) can’t find a way to answer this question to a reasonable degree of accuracy without falling back to “yolo let’s see what happens” you are in no position to be doing this research.
Regardless, they (reportedly) _attempted_ to prevent internet access. They just didn’t in a way which can be escaped via software.
Yes, side channel exploits exist in airgapped environments to. But if a model found a way to escape an airgapped environment via non-networked side channel attacks then the correct answer is frankly “shut it down immediately and then thermite any machine it touched”