alt Hacker NewsI think it is more about comprehension. It reveals that AI does not actually understand what it does. It gets code right mostly because it is probabilistic and has seen enough sound precedents to land in something that works, but it does not come from an internal comprehension.
For code it also has tools to verify correctness. From specifications to compilers and tests.
With humans language, sometimes "wrong" is in fact "right."