logoalt Hacker News

singularity2001yesterday at 7:51 AM1 replyview on HN

If anything their capability of abstract inductive reasoning is way beyond the average human given how much better LLMs are at solving math problems, it's the paradox that they can do complicated reasoning before they can do intuitive peep-pe-boo.


Replies

kronayesterday at 10:04 AM

abstract inductive reasoning requires dynamic learning in unfamiliar contexts. All the benchmarks which measure this specifically (in particular, task composition) see LLMs fail catastrophically. There is quite a lot of research published on these limitations now.