logoalt Hacker News

chriddyp • today at 1:05 AM • 0 replies • view on HN

Big improvement over Kimi K3 in our data analytics benchmark: it scored a 98% vs a 81% in July.

Quite slow in our exam. A lot of that was due to the number of tool calls that it's making. In one of our questions about finding data issues in a dataset, it made 73 queries. Other models like 6.1 Sol only made 18 for that question.

Full deep dive here: https://plotly.com/blog/kimi-k3-1-pro-plotly-data-analytics-...