alt Hacker NewsWow. This is absolutely wild. I didn't expect that.
If we get to anywhere near this speed for the equivalent of the current models... I don't even know what to think about that future.
Replies
blovescoffee • yesterday at 11:15 PM
what do you mean "if"? of course we will, and the models will be smarter as well
➕ show 1 reply
Speed is the metric I'm currently most interested in. The models are smart enough.
Once speed significantly increases I think we're going to see some interesting downstream effects. The three things I currently spend the most time waiting on are LLM API requests, Rust compile times, and nix derivations. As AI latency approaches zero I think we're going to start taking a hard look at whether slow-compiling languages are adding enough value over Golang, Typescript, or even dynamic languages to be worth the slowdown.