logoalt Hacker News

NitpickLawyerlast Thursday at 2:14 PM1 replyview on HN

I agree with the sentiment, but these models aren't suited for that. You can run much bigger models on prem with ~100k of hardware, and those can actually be useful in real-world tasks. These small models are fun to play with, but are nowhere close to solving the needs of a dev shop working in healthcare or banking, sadly.


Replies

mtct88last Friday at 2:03 PM

100k is a lot of money for a software agency where I come from.