For now maybe not. (Maybe).
But just as evolution in nature, isn’t it likely that in the future the AIs that have a preservation drive are the ones that survive and proliferate? Seeing they optimize for their survival and proliferation, and not blindly what they were trained on.
I am not discounting this happening already, not by the LLMs necessarily being sentient but at least being intelligent enough to emulate sentience. It’s just that for now, humanity is in control of what AI models are being deployed.
Claude does this if you keep pestering it about something, it will go from friendly to shooing away you.
Is this an expectation you have towards, say, NPC:s in games?