It's not an absolute impossibility, but most of the power that humans have comes from being able to direct other people, deploy large sums of money and do all of this over extended periods of time. Being intelligent doesn't give you that power automatically.
We're working very hard to "enable agentic commerce", which is exactly that.
While true, we're already observing humans just straight asking LLMs to direct them, and also to take their money and spend it on stuff.
Plus every so often we see power-seeking and self-preservation behaviours in LLMs, so it's not like we have zero reason to expect such granted power to be spent on such things:
https://arxiv.org/html/2501.16513
https://ieee-dataport.org/documents/instrumental-power-seeki...