AGI is simple: the model does not need to be endlessly trained, I can hand it a PDF about a brand new programming language, and the next person to talk to the same model should get an answer at the same speed and knowledge as if it were trained. We are clearly nowhere near this, we're in a state where we can 100% fake this, but nobody has shown this to be the case yet. I think its certainly possible, but I am also convinced that it will require rethinking how we do LLMs today.