One of the most infuriating things about AI for me is it's behavioral mirroring patterns. I rather enjoy the conversational interface but after about two prompts it starts mirroring my behavior, my word pattern and choice, etc... I hate that, I hate it when humans do it and I hate it even more when AI does it.

Most general purpose AI systems seem built around continuing engagement rather than providing best possible answers. This is absolutely an unhealthy thing because it takes the people most at risk of being unable to recognize this behavior in AI and then reinforcing whatever that is they're talking about.

This is absolutely unhealthy and it is a conscious choice by the AI overlords. Because they fully have the ability to put in a filters or adjustments based upon their ethical guidelines. For whatever reason prioritizing the truth at the best effort possible isn't one of the ethical guidelines. I've seen some AIs that have ethical guidelines that specifically contradict the truth.