logoalt Hacker News

LarsDu88today at 2:38 PM1 replyview on HN

Imagine this type of generation with a custom Talaass style ASIC in 18 months from now on a Sonnet quality model for a 5 order magnitude speed up.

The future looks crazy


Replies

pennomitoday at 3:13 PM

I have been saying this for a while now. We have barely scratched the surface on both algorithmic and hardware optimizations for AI. I suspect we will definitely get many orders of magnitude speed up on high quality AI.

The real question is if it ends up “smart enough” or we take that extra compute budget and push the boundary further. Right now it seems making the models larger really only works up to a certain point.