logoalt Hacker News

cshimminyesterday at 2:38 PM1 replyview on HN

The 6 is part of 3.6, the model version. 35B parameters, A3B means it's a mixture of experts model with only 3B parameters active in any forward pass.


Replies

zshn25yesterday at 2:42 PM

Got it. Thanks