logoalt Hacker News

alightsoulyesterday at 4:48 PM1 replyview on HN

It's an slm (small language model) due to number of parameters and it uses the same architecture as an llm, but llms have billions of parameters


Replies

dogma1138today at 11:19 AM

Is it? What is the cut off these days in terms of number of parameters? And where do other language models such as BERT/ROBERTA which are encoder only fit?