alt Hacker NewsI’m not sure if this is the right solution, but we clearly need better tools for the legal space. Anthropic's recent policy update makes this abundantly clear:
“When our products are used in ways that can affect someone's health, legal rights, finances, livelihood, or access to essential services, we require there to be a qualified ‘human in the loop’ (that is, someone who has the authority to review and, if necessary, change Claude’s recommendations), and for the individual affected to be told that AI was used.”
Something as common as a family law case has the potential to affect all of the above. Now imagine being a petitioner, respondent, paralegal, or other 3rd party using Claude to review a draft document only to find out that Anthropic has sent your entire file to opposing counsel.
It sounds egregious, but Anthropic is clearly stating they will use their own judgment to control what people can do with its product, and that they will treat customer data as if it's theirs to disseminate. So there's a massive opportunity for an unbiased tool willing to fill this void.
Replies
Anthropic's paternalism is so irritating. I refuse to pay for their products, since they clearly don't respect me as a customer. And I actively discourage corporate procurers from getting in bed with them.
>“When our products are used in ways that can affect someone's health, legal rights, finances, livelihood, or access to essential services, we require there to be a qualified ‘human in the loop’ (that is, someone who has the authority to review and, if necessary, change Claude’s recommendations), and for the individual affected to be told that AI was used.”
This is actually good policy imo, if you are using AI in a way that can negatively someone's life there should be a human involved.
> Anthropic is clearly stating they will use their own judgment to control what people can do with its product
Haven't they been perfectly clear about that from day one with the ToS? I'm not saying I like it but it hardly seems unreasonable.
> they will treat customer data as if it's theirs to disseminate
Not sure where you're getting that. What you quoted in no way implies that.
The traditional legal data brokers like Thompson Reuters provide AI solutions presumably with considerably better data governance.
https://www.thomsonreuters.com/en-us/posts/innovation/thomso...
it's like Uber, for lawyers!
And now you're not allowed to "abuse" their code (i.e. swear at it).
I wouldn't be surprised if that turns out to be their stupidest mistake. I mean, if I can't swear at their code is that b/c they think it's conscious? In which case they're liable for providing me with an employee that makes mistakes rather than just software?
I must be misunderstanding something because this is how your comment reads to me
> Anthropic: you can't use our product to fully-autonomously make decisions that affect human health, finances, etc with no human in the loop.
> victor9000: If you review a draft document with claude, anthropic will send your entire file to opposing counsel
What is the connection here? Anthropic has obviously never done anything like this and it's not indicated that they will by the thing you quoted.