> then pointed AI at it and had it implement code until every test passed.

You used to have two problems. Now you have three.