alt Hacker Newsstill waiting for the day I can comfortably run Claude Code with local llm's on MacOS with only 16gb of ram
Replies
3yr-i-frew-up • today at 10:32 AM
[dead]
still waiting for the day I can comfortably run Claude Code with local llm's on MacOS with only 16gb of ram
[dead]
My super uninformed theory is that local LLM will trail foundation models by about 2 years for practical use.
For example right now a lot of work is being done on improving tool calling and agentic workflows, which tool calling was first popping up around end of 2023 for local LLMs.
This is putting aside the standard benchmarks which get "benchmaxxed" by local LLMs and show impressive numbers, but when used with OpenCode rarely meet expectations. In theory Qwen3.5-397B-A17B should be nearly a Sonnet 4.6 model but it is not.