logoalt Hacker News

dd8601fnyesterday at 10:23 PM1 replyview on HN

Is this the chatjimmy asic approach with a bigger model?


Replies

ericdyesterday at 11:54 PM

No, the asic could only ever run one model/set of weights, no updates possible, ever. These are general purpose processors that can have their models updated. But the chips are enormous, with a substantial amount of on-die memory alongside the execution units, for a relatively insane amount of memory bandwidth.

show 1 reply