A lot of these ‘an agent invented’ or ‘an agent solved’ are actually the agent wading through a lot of info and finding something a human did that no one noticed or saw the relevance of at the time.
If ai becomes so prolific that we humans all stop doing those things then will they still work?
Well its not just any old human doing these things in a general sense. Its typically academics or highly paid researchers who love doing work like this. So, I don't think it will just one day stop
Yes, as long as we are advancing to behavior and world models, so that agents can interact with the world themselves. Which we are.
Which is somewhat ironic since neural networks were "discovered" back in the 1940s... then forgotten... then wait, they were discovered again! ... then forgotten, again... and now here we are.