logoalt Hacker News

bmitc • yesterday at 9:49 PM • 1 reply • view on HN

How do you know what Opus 5.5 is doing? How do you know it's correct?

Just earlier today, I had Opus 5.5 try and read an X-ray. It struggled to give any real information.

Stitching algorithms together is also not hard.


Replies

ggm • yesterday at 11:52 PM

He has an exterior model in ground truth: you take a pig, you anaesthetise it and isolate an organ, and you measure flow rate in a live subject.

When the model is shown to be within tolerance of what you can measure in the accepted standard methods right now, you can move over with confidence.