Can I put it as Air Traffic Controller? With similar error rates as humans?
That would be the litmus test.
"Does not hallucinate" is not the same as "is never wrong".
So the ATC test could be the benchmark.
Not hallucinating is easy when you don't produce strings.
Not hallucinating is easy when you don't produce strings.