logoalt Hacker News

bityardlast Wednesday at 11:40 PM3 repliesview on HN

Correct, a rack full of datacenter equipment is not going to compete with anything that fits on your desk or lap. Well spotted.

But as a counterpoint: there are whole communities of people in this space who get significant value from models they run locally. I am one of them.


Replies

kamovlast Wednesday at 11:53 PM

What do you use local models for? I'm asking generally about possible applications of these smaller models

show 1 reply
Graveylast Wednesday at 11:50 PM

Would you mind sharing your hardware setup and use case(s)?

show 2 replies