alt Hacker NewsI don’t know how this wrapper works, but if it is like any of the classifiers I’ve had Claude build off an LLM in the past, it grabs the probabilities of the tokens you are looking for, and then computes their relative probs against each other.
Even if the LLM thinks it’s made up D is the highest probability, that isn’t part of the set.
You never actually generate the prose, only the first pass, and grab the probabilities. It couldn’t ask for more details even if it wants to. It gets stopped before the first token renders.
I guess “A” by itself would be a seperate token but my point is the model might be trying to say something that begins with that letter rather than actually answering.
You’d need to use an approach that links the output to a closed set.