I’ve run those experiments. Commercially, so I can’t share data. But I can say what the article describes roughly matches what I’ve seen. How well calibrated the scores are varies by model, application, and subtle wording changes. I’m a little more optimistic than the author in that I have gotten it to work reasonably well. But I would not recommend productizing it with a SaaS LLM because it will break every time your vendor sunsets the model you were using, and getting it working again on a new model will be an unholy PITA.