logoalt Hacker News

ar_lan • today at 5:30 PM • 0 replies • view on HN

This seems like a very strange comment to come from someone I am assuming is a SWE. When have we, ever, been happy with non-deterministic, objectively more expensive, solutions?

You're assuming a lot of costs that should just be considered ok in your stance:

* Why pay anything multiple times when you can replicate deterministically for free? * Why require always-online models when you can run computation locally? * Inversely, why use power-hungry/PU-hungry models locally when you can have a deterministic software that can be optimized to not* be memory/PU/power hungry to do validation?

I think tokenmaxxing can be a great start* to get things going but when it comes to productizing I want determinism and cheap optimizations, and using frontier models to build these cheap optimizations is what we've been doing at our company over this past year to great success.