logoalt Hacker News

selcukatoday at 6:05 AM0 repliesview on HN

It's a quantised 8B model (Llama 3.1 8B to be exact).

[1] https://taalas.com/the-path-to-ubiquitous-ai/