logoalt Hacker News

RealityVoidyesterday at 10:13 PM1 replyview on HN

Talaas, from what I understand is building stuff just like that. The infra is the same and the weights layer is all you need to change. I guess you could half etch the chips and then finish them with the weights only. I think their turnaround is 6-8 Weeks. The size of the models fitting on the chips at the moment is llama 3 I think?


Replies

derefryesterday at 10:43 PM

> I guess you could half etch the chips and then finish them with the weights only.

Basically a https://en.wikipedia.org/wiki/Gate_array. (The non-field-programmable kind.)