logoalt Hacker News

holodukelast Sunday at 1:45 PM3 repliesview on HN

I spend full 20x the week quota in less than 10 hours. How is that possible? Well try to mass translate texts in 30 languages and you will hit limits extremely quick.


Replies

pxclast Sunday at 1:58 PM

Translation generally works well with very small models compared to the frontier LLMs. You can definitely run a model on your own hardware for this.

show 1 reply
peterpanheadlast Sunday at 2:05 PM

That's a really gnarly task but I'm shocked it burns 20x that fast. How large is the text? That matters more than anything.

show 1 reply
Perz1vallast Sunday at 3:27 PM

Should have switched the model to Haiku