alt Hacker NewsI think the better analogy is an insane nuclear power plant manager deciding it wants to buy pens to use as neutron-flux regulator rods — because after all, a pen is functionally a pencil and a pencil is made of graphite.
Then the pen manufacturer hears about this and says “Our pens are not made of graphite and are not suitable to be used in nuclear reactors”, to which the reactor owner says “it’s fine, they fit in the graphite rod holes, and we’re just using until the next generation of pens come out which will do an even better job”, and then the pen manufacturer says “I’m not going to sell you any pens until you agree that they will be used only writing.”
Replies
That analogy still makes this sound like a textbook designation. In that situation the pen manufacturer is expected to sell pens without a theory of what will happen next. The person who buys a pen might use it to kill someone or commit horrific legal/moral crimes and that has nothing at all to do with the pen manufacturer.
I can see how I might reasonably refuse to deal with that pen manufacturer. The pen manufacturer is unreasonably pushy and they're going to be massive trouble to deal with because they're all up in my business in a paranoid way and disrupting my use of their product. Companies have made my never-again list for far smaller slights.
This is the most accurate parallel as far as I can tell. I've not seen any evidence that Anthropic deliberately built automated systems or escape hatches that literally prevent the US Government from using Claude to do these things. Other than the basic AI Safety mechanisms in place for everyone/general use. It's almost the reverse, where they explicitly don't want to strip away guardrails that say things like "don't kill people".
The intent and framing matters a lot here. Refusal to remove safety features is a LOT different than deliberately building mechanisms to sabotage would-be operations.
The previous power plant manager had, of course, already signed a contract agreeing to those terms; the power plant is subsequently under new management and upset about being bound by this contract, so they designate that none of their suppliers of parts and fuel are allowed to have any commercial dealings with the pen manufacturer or use these pens for any purpose, even writing.