Gary Marcus is not the man to be looking to on this topic
Gary Marcus successfully wrote an article about getting image generation models to show a horse riding an astronaut, which is all I needed him to do. (Actually he wrote two, but this one felt more concise.) Take it as an existence proof, not an endorsement.
Gary Marcus successfully predicted all ten of the one AI Winters.
He also claimed that LLMs were a failure because of prompts that GPT 3.5 couldn't parse, after the launch of GPT-4,which handled them with aplomb.