alt Hacker NewsWell even programmable ASICs like Cerebras and Groq give many-multiples speedup over GPUs and the market has hardly reacted at all.
Replies
mips_avatar • yesterday at 1:45 PM
The problem with groq was they only allowed LORA on llama 8b and 70b, and you had to have an enterprise contract it wasn't self service.
fooker • yesterday at 9:15 AM
> market has hardly reacted at all
Guess who acqui-hired Groq to push this into GPUs?
The name GPU has been an anachronism for a couple of years now.
➕ show 1 reply
IshKebab • yesterday at 12:57 PM
Cerebras gives a many multiple speedup but it's also many multiples more expensive.
Seems both Nvidia (Groq) and OpenAI (Codex Spark) are now invested in the ASIC route one way or another.