alt Hacker NewsI wonder why computer use has taken a back seat. Seemed like it was a hot topic in 2024, but then sort of went obscure after CLI agents fully took over.
It would be interesting to see a company to try and train a computer use specific model, with an actually meaningful amount of compute directed at that. Seems like there's just been experiments built upon models trained for completely different stuff, instead of any of the companies that put out SotA models taking a real shot at it.
Replies
The industry probably moves a lot faster adding apis and co than learning how to use a generic computer with generic tools.
I also think its a huge barrier allowing some LLM model access to your desktop.
Managed Agents seems like a lot more beneficial
The trillion dollar "Computer Use" model could not figure out how to configure audio outputs in Microsoft Teams. It then model-collapsed when trying to configure an HP printer. AGI was postponed, we'll get back to this after next weeks retrospective.
On the other hand, I never understood the focus on computer use.
While more general and perhaps the "ideal" end state once models run cheaply enough, you're always going to suffer from much higher latency and reduced cognition performance vs API/programmatically driven workflows. And strictly more expensive for the same result.
Why not update software to use API first workflows instead?