Completely agree it's not human and anthropomorphizing might not be constructing. But I think we need to figure out _some_ kind of analogy that doesn't have us leave or brains in the drawer when interacting with it. Given ample sci-fi lore about all-powerful "Godlike" AI machines, playing the "machine" analogy might be equally problematic. If people think "well, obviously it's not a toaster, it's skynet", or some such.
Yes but that's an easy thing to say for people that already "think for themselves", this could be (already is, 4o) a dangerous precedent to set.
We do create relationships ships with tools. I used to do plenty of manual labour in the past - railway and building construction, AV installations etc. and I have a degree in sculpture - and having a trustworthy Makita or even better a Hilti -driver as your companion felt like an assuring companion in the cold cruel world. Like one tool that is a bit special and has become almost a part of your arm. “There’s many like it, but this one is mine”. And of course probably everybody here has created a some sort of a loving friendship with their computer. Personally, I have a huge crush on Neovim at the moment. I don’t understand how I ever got anything done before I started using it.
I use Kimi K3 on OpenWebUI running on my desktop, which I can access via Tailscale on all my devices. Personally I really dislike using LLM’s to generate code - luckily I don’t work as dev - a mental block I need to solve at some point, but in researching and learning it is wonderful, when you use a system prompt to force it to search for info instead of hallucinating from training memory. It is just so much quicker than researching it with web searches yourself. To me it is a really sharp good knife that helps me to do what I want to do. Not a friend in a human sense, but a companion. Cowboy has a revolver, a samurai his sword… a hacker an nvim and llm, perhaps?