All code has bugs, the vector space of all possible bugs determines the entropy of the problem space for a large language model to traverse.
Reduce entropy, increase probability of the correct outcome.
LLMs are surfing higher dimensional vector spaces, reduce the vector space, get better results.