How do you know that not connecting it is sufficient to stop the spying?

There are a few large IoT-focused networks like Amazon Sidewalk where conceivably the smart TV could connect to them if you don't connect it to your home wifi. I believe many ISPs like Xfinity also runs shared public wifi from their routers - a tv could connect via your neighbor's ISP-provided router and you wouldn't have any idea.