logoalt Hacker News

jazz9kyesterday at 12:25 AM4 repliesview on HN

This does sound great, but the cost of tokens will prevent most companies from using agents to secure their code.


Replies

KetoManx64yesterday at 1:00 AM

Tokens are insanely cheap at the moment. Through OpenRouter a message to Sonnet costs about $0.001 cents or using Devstral 2512 it's about $0.0001. An extended coding session/feature expansion will cost me about $5 in credits. Split up your codebase so you don't have to feed all of it into the LLM at once and it's a very reasonable.

show 4 replies
NitpickLawyeryesterday at 9:52 AM

Tokens aren't more expensive than highly trained meatbags today. There's no way they'll be more expensive "tomorrow"...

show 1 reply
qingcharlesyesterday at 3:50 PM

I'm thinking about how much money Anthropic etc are making from intelligence services who are running Opus 4.6 on ultra high settings 24 hours a day to find these kinds of exploits and take advantage of them before others do.

Expensive for me and you, but peanuts for a nation state.

epolanskiyesterday at 9:30 AM

I don't buy it.

Inference cost has dropped 300x in 3 years, no reason to think this won't keep happening with improvements on models, agent architecture and hardware.

Also, too many people are fixated with American models when Chinese ones deliver similar quality often at fraction of a cost.

From my tests, "personality" of an LLM, it's tendency to stick to prompts and not derail far outweights the low % digit of delta in benchmark performance.

Not to mention, different LLMs perform better at different tasks, and they are all particularly sensible to prompts and instructions.