Increasingly AI seems to be mostly downside. A legal chat bot without attorney-client privledge, also implies a medical chatbot may have no HIPAA protection. It renders the service unsafe and therefore unusable and maybe more importantly... unsalable.
Why are you taking what is clearly a legal problem and making it about the technology? The law could simply grant attorney-client privilege to chatbots. Nobody is arguing the advice was bad or more expensive than a real lawyer.
This is a court issue, not a technical one. This has so many side effects that weren't thought through (Using Gmail to draft a letter to your attorney, but gmail has enabled AI editing...).
Seems dumb, and like it will cause quite a few issues until it is overturned.