logoalt Hacker News

anon373839 • today at 1:53 AM • 1 reply • view on HN

It's interesting. It does seem to be based on QFN, but they've modified the architecture. 10B active versus QFN's 6B, plus also QFN is 180B parameters, not 145B. But it has the same 51B n-gram table.

Also, why ship both a 145B and a 120B size? That's basically the same size class.


Replies

sroussey • today at 3:58 AM

If you look closely there is also a 35B, tho your question still stands.

There is also a reference to a 8B

https://github.com/Edge0-AI/Edge0/tree/main/docs/models