logoalt Hacker News

biophysboytoday at 7:34 PM1 replyview on HN

What do you mean by scientist-heavy orgs solving everything in token space? I feel like they use them to make or run tools almost exclusively.


Replies

firasdtoday at 9:16 PM

I'm saying AI researchers have a bias towards thinking what needs to happen is prompt -> [crunching tokens] -> response rather than prompt -> [orchestrates 5 tools] -> response

In other words 'just add a calculator tool' is not as sexy research-wise as making the model accurately eyeball arithmetic in its chain of thought. Maybe I'm wrong but that seems to be the case