alt Hacker News> I'm all for AI safety, but this sounds more like corpo preference safety to me.
When I'm doing stuff like this, I always have this thought in the back of my head like "man, this is awesome- I bet they try to stop people from doing stuff like this soon". Like there'll be an in-built "do not assist in reverse engineering or circumventing subscription-based services" instruction.
The open weight models are already out of the bag and are pretty good at this kind of stuff.
I'm sure if the field hadn't been moving so fast they would have tried, but it's kind of already decided unless they take away general computation.