logoalt Hacker News

jesdo • yesterday at 3:42 PM • 1 reply • view on HN

Overall, a fair assessment. I do want to place a footnote here that we did fix vLLM in the sense that its correct behavior for Kimi required code changes: it was impossible to fix it in the configuration. Later, the vLLM team fixed this problem upstream. Now, with the latest version of vLLM, the problem we describe can be addressed by setting the `--tool-strict-level` flag to `parameter`.


Replies

wredcoll • today at 5:10 AM

If you work for ubicloud, I have a question: do you sell api access to kimi/etc, and if so, where is that listed??