logoalt Hacker News

rufasteriscoyesterday at 8:39 PM0 repliesview on HN

some small models are fast, and fine tuning can be done locally

for example in gaming context, if you need an answer below 5 seconds, they are the sweet spot