logoalt Hacker News

coffeekidtoday at 10:29 AM0 repliesview on HN

Pretty much. Running a local harness calling an llm via APIs doesn't necessarily take a lot of resources. But whatever tasks you want that agent to do via tool calling will be limited by the resources of the machine it runs on if you run those locally, so that's what should inform your choice of specs in this case