logoalt Hacker News

swyx • yesterday at 7:22 AM • 1 reply • view on HN

i think well argued and a reasonable hypothesis (esp considering deepseekocr and most omnimodel research), but you are wrong heheh. approximating instantaneous physics is, while nontrivial, still computationally light vs the stuff we ask LLMs to do.

look at any study of llm depth vs multihop reasoning capability (here, just to help https://www.latent.space/p/ainews-death-of-params-zai-ceo-ji... but theres a long line of others).

i will grant that people do do "reasoning in image models" type benchmarks, and it's not nothing, but its kid stuff vs what we make LLMs do, and the only way you get image models that basically do reasoning is you glom a diffusion head on an LLM backbone, which is basically gpt image 2.0 and above

none of which is to dispute the original question which is perhaps "why are image models so smol vs LLMs" - which i agree with and wish there were funding for scaling them - but the abject failure of sora indicates that perhaps our data isn't nearly good enough (again pointing to another thing - much easier to pretrain and posttrain LLMs given quantity of text data)


Replies

soulofmischief • yesterday at 7:47 AM

What specifically are you claiming is wrong about my comment? I never made any comparison to LLMs, I spoke about training multimodal models and how image models are doing not just superficially memorizing the looks and composition of concepts.