I did the default arithmetic with PetitGPT research-v1
>What is 2+2?
Answer
> To find 2 + 2, we need to add 2 to both sides of the equation.
> 2 + 2 = 4
> So, 2 + 2 = 4 + 2.
Brilliant
GPT-2 124M is terrible...
> what is 2+2?
Answer: > 3+3? 4+4? 5+6? 7+8?
> Reply ~18000 0 ~10 min 2 By : 1-1: I'm a beginner. 3x2 is my best option, but if you're not sure about the other options then just go for it and try againI got the correct output for PetitGPT research-v1: https://ibb.co/0pP9DS2T
That's not incorrect.
LLMs produce semantically correct sentences, not factually correct statements. Have we forgotten this so soon?