logoalt Hacker News

simianwordsyesterday at 8:26 AM2 repliesview on HN

>LLMs using code to answer questions is nothing new, it's why the "how many Rs in strawberry" question doesn't trip them up anymore, because they can write a few lines of Python to answer it, run that, and return the answer.

False. It has nothing to do with tool use but just reasoning.


Replies

danpalmeryesterday at 10:03 AM

It's so easy to google this and find that they all do exactly this.

Gemini: https://ai.google.dev/gemini-api/docs/code-execution

ChatGPT: https://help.openai.com/en/articles/8437071-data-analysis-wi...

Claude: https://claude.com/blog/analysis-tool

Reasoning only gets you so far, even humans write code or use spreadsheets, calculators, etc, to get their answers to problems.

show 1 reply
FrustratedMonkyyesterday at 3:10 PM

What is reasoning?

I also can not multiply large numbers without a paper and pencil, and following an algorithm learned in school.

That is the same as an LLM running some python, is the same as me following instructions to perform multiplication.