Here are a few:

* Forming a long lasting memory from a single encounter

* Speed of adaptation to new environments

* Deft manual dexterity, like playing the violin and needlework

* Competing in a triathlon (requires running, biking, and swimming)

* Having a single agent that can do ALL of those things and more

Humans understand and perform tasks in many more than just the few modalities current model providers have focused on. I'm not discounting the utility of current models in the limited domains they operate in, but they are no where close to being generalists like a human or other animals.

I don't feel like the models are becoming any better at writing.

Rap lyrics are a good test. They are on the level of a censored version of Insane Clown Posse. Just terrible.

The goal post seems to be changing weekly:

It can’t even play a basic video game!

Now it can

It can never beat the best human go player!

Now it can

It can’t even make a video of will smith eating food!

Now it can

It can’t do basic math!

Now it can

It can’t code as well as a junior?

Not it can

It can’t pass the bar or other certificate exams!

Now it can

It’s never going to meet senior level programmers!

Now Linus says it’s better at coding than him

It can’t do high level maths!

Now it can

It can’t solve math problems humans cant!

Now it can

It can’t do RSI

…

The ability to solve general problems previously insoluble using only experiential data and modification to internal world models.

politics