This may be true now but isn’t the trend clear? GPT-2 couldn’t write a coherent function. Now we have the SWE oracle that can autonomously navigate your codebase, write code at a superhuman level, and give the correct answer to most engineering questions.

If anything I feel I am understating the capability of current models here. What is stopping the next generation of models from closing the feedback loop further?