logoalt Hacker News

rubicon33yesterday at 4:39 PM2 repliesview on HN

And you’ve opened wireshark and verified the model is sending absolutely nothing? Not caching and sending later, etc?


Replies

adrian_byesterday at 6:00 PM

If you self host then you can audit the open-source llama.cpp or whichever other program you are using for inference, to see exactly what it does, and also whichever open-source harness you use for implementing a coding assistant or other agentic workflow.

The model consists of a bunch of data files, it does absolutely nothing by itself.

If you run inference on your own hardware, you have absolute control on how the LLM is used, not like when you use an external service provider.

razemioyesterday at 5:56 PM

Not sure if you mean something else, but the model itself is not able to send anything.