logoalt Hacker News

HumanOstrichyesterday at 7:19 AM0 repliesview on HN

How much extra power do you think you would need to run an LLM on a CPU (that will fit in RAM and be useful still)? I have a beefy CPU and if I ran it 24/7 for a month it would only cost about $30 in electricity.