I don't think intuition about the things that a specific type of monkey cares about is a prerequisite for "AGI".
I mean we did create the technology and came up with the concept of intelligence, as we understand it (and defined the term AGI based on our concept of intelligence).
Why do people insist on talking about AI like it’s some supernatural, otherworldly creation? No matter how advanced it is, it’s still human technology.
"a specific type of monkey" is a funny way of saying "the only generally intelligent thing we are aware of".
I don't think you understood the point at all.
Ask a model whether a human purchasing clothes would care about clothes fitting well, or the price, or the opinion of their romantic partner. The model will in all likelihood get the answer right. Familiarity with human preferences is not what's missing, which is hardly surprising considering an LLM is trained on human-made content.
What it lacks is the ability to notice and surface these non obvious constraints when relevant. This is fundamental to real world decision making.