We're running Kimi 2.8 on a 4x AMD MI300A single server on-premise that cost about $110k.
We will break even from our old Claude spend in about 2 weeks.
It services 30-40 analysts and staff concurrently and is faster than any of the SaaS out there for us.
Are they happy with Kimi 2.8's reasoning ability? I haven't tried it.
There's no Kimi 2.8 as far as open weight is concerned. WTF. This must be a bot and other bots.
Very cool
Wow... I'd like to know more. 40 analysts not spending 100USD/month is 4k/month saved. That means you break even in 27 months. But you probably used Claude much more than that.
Also what harness do you use? Any problems you encountered on the way?