This is why I hate the IoT (Internet of Things) it should be CoT (Communication of Things).
That speaker linked to your phone should not need an internet proxy to communicate. It should allow for direct USB communication so it can share one power source. It should allow for Bluetooth communication so it can be in a different close location.
CoT should follow the rule of nature and take the shortest path by default.
What is better for society? The LLM modal running in a local environment or the one running on a data center that can be easily taken out via a power outage, fiber cut, national disaster, or a kinetic weapon?
I rather that LLM modal used at the hospital be ran locally and keep servicing patients even though the original data center was demolished by mother nature.
It should have been Intranet of Things.