Every psychologist and therapist I have talked to about using LLMs in place of personal interactions (just discussion about this topic) have all said roughly the same thing:

Any attempt to use LLMs as a substitute for personal interaction is playing an incredibly dangerous game that will probably make them a lot of money, while hurting a lot of people.