logoalt Hacker News

kzrdudetoday at 7:03 AM0 repliesview on HN

We don’t know but I think we assume that it is MoE or some almost equivalent sparse activation technology.