I'm not sure how you call a model AGI without it learning new information at the model level and not introducing nasty surprises (both from adversarial users and unintentional badness)

I guess there is fine tuning (and RAG) for those that need something bigger than just the knowledge contained in the context.