alt Hacker News> Claude is obviously more expensive, but it caught entirely hallucinated sentences created by Mistral OCR 4.0, so I was glad for the backup check.
What does this entail? What does Claude do to decide that the text it was provided was hallucinated? Are you telling Claude that the source was OCR'd by another LLM?
Replies
runtime_lens • today at 7:44 AM
I read that as “hallucinated” in the practical sense: the OCR output contained text that wasn't actually present in the scan, rather than just misreading a character.
➕ show 1 reply
mattnewton • yesterday at 11:05 PM
I assume they pass the image alongside the text to redo/recheck the work. Yes this is silly, but is apparently required to get around refusals.
I'm basically doing the OCR twice, except in the Claude proofreading pass, it is not being asked to transcribe the document to a Markdown file. I'm pointing it to the same image input files, and to the Mistral OCR transcript Markdown file (it knows it's a Mistral OCR output), and ask Claude to check that the text is correct and point out the errors - and then make the necessary edits.
I can't speak for Mistral OCR 4.1, but the hallucinations in 4.0 were so egregious (just completely making up new sentences in the middle of a page) that I knew I can't trust Mistral OCR on its own.