logoalt Hacker News

slopinthebag • yesterday at 3:09 AM • 1 reply • view on HN

if the llms aren't spending, why do they need cost caps?


Replies

strangecasts • yesterday at 7:50 PM

Because they cost money to run - Simon is discussing this in terms of the billing from services, not some hypothetical scenario with LLMs spending money on your behalf

If you were recommending VPS providers to someone new to making web apps, it would be malpractice to recommend one that can bill them thousands if they misconfigure things (like AWS previously did), and Simon's argument is that LLMs should likewise favor services with budget caps