alt Hacker NewsBy that logic, any software you run that isn't fully built by yourself is "third party" therefore you shouldn't run anything at all on your machine, thus obviating the need for it entirely.
By that logic, any software you run that isn't fully built by yourself is "third party" therefore you shouldn't run anything at all on your machine, thus obviating the need for it entirely.
But practically AI inference requires substantial local computing resources. It's not some web app, it's a order of magnitude more compute needed