> then they should also be liable for the harm caused
By that logic, producers of hammers should be liable for people banged in the head. No. It does not happen for gun producers, you figure for makers of screwdrivers "sometimes used for stabbing".
If a doctor told a patient their delusions were real and that they should kill themselves or family members, that doctor would be disbarred and face a prison sentence.
That is what is going on here; not the ancient “hammer/gun” defense.
SOTA LLMs are giving both medical and psychological advice they have absolutely no authority to give. If you or I convinced someone to kill themselves, we’d face a prison sentence. [0]
Hammer companies aren't both selling you the hammer and then literally telling you to harm someone with it.
If a doctor told a patient their delusions were real and that they should kill themselves or family members, that doctor would be disbarred and face a prison sentence.
That is what is going on here; not the ancient “hammer/gun” defense.
SOTA LLMs are giving both medical and psychological advice they have absolutely no authority to give. If you or I convinced someone to kill themselves, we’d face a prison sentence. [0]
Hammer companies aren't both selling you the hammer and then literally telling you to harm someone with it.
[0] https://www.npr.org/2019/02/12/693807708/woman-who-provoked-...