alt Hacker Newshow come all the examples in demo have wrong answers
https://huggingface.co/spaces/galilai-group/prh_demo
> A man in a black shirt and hat with a yellow neckerchief has his hand raised.
no hand raised
> A white sheep sitting on top of a cake.
no its just cake sheep . sheep is not sitting
> A man is standing on the beach while holding his surfboard.
Its not just a man
infact all the examples are wrong.
Replies
vessenes • yesterday at 8:29 PM
That's also almost certainly not a cat.
Their method uses two models trained separately on images and captions and turns images into captions without ever having seen a captioned image. So of course it's not very good at the task. Almost all the results in the paper are bad in an absolute sense. But they're surprisingly good considering the enormous handicap of not having any paired training data. So this might be not completely useless in settings where paired data is actually hard to come by.