ChatGPT medical advice brought man 'to brink of death', lawsuit alleges

All the chat bots have a very discreet disclaimer at the bottom of the page. I want to say it should be bigger text and more strongly worded but like most people I would just mentally tune it out regardless.

I really hope the lawsuit does not end in OpenAI tightening the “safety” and “security” of their models into oblivion. I hope they understand that a lobotomized model is as good as my Casio watch.

I want my models to give it to me straight without patronizing me. I’m an adult and I take responsibility for my own actions.

The amount of times these LLMs randomly refuse to answer basic questions because "omg safety" only to turn around and do this f￭￭￭ing nonsense is obscene.

I'm not blaming the LLM because it's just a pile of math glued together with hubris and anxiety but why is its default response not "I am not a medical professional and you should see a doctor right away if you have any concerns"?