I wonder if they will improve in a specific direction - frameworks and libraries built to be easier for LLMs to use.

This could even happen through accidental evolution - a framework that is easier on an LLMs context window results in more successful projects, which results in more training data, which results in LLMs being even better at it.