logoalt Hacker News

ActorNightlytoday at 5:17 AM0 repliesview on HN

Running local models isn't about the cost, its about owning your own data and being able to run uncensored models. If you just want to code with an assistant, local inference is by far not worth it.

You also don't need to run the models 24/7, nor is your computer gonna be doing inference all the time when you are coding.