alt Hacker News> Anyway the point is these models are just about capable of doing the entire job of analyzing a small business and building out all the agents and iterating on them with the business owner.
If you search for LLM benchmarks focused on real-world tasks, you'll quickly learn this ain't the case. No point in telling business owners about that though, they need to see/learn by themselves.
Replies
he is the real world. he is telling you that it is the case. when will you people wake up. this shit is real and happening. people who would have reached out to you asking for help are now not doing that. people to whom you would otherwise have gone for help are no longer hearing from you or never met you in the first place.
If only LLM benchmarks could benchmark it in the first day!
Still no Artificial Analysis benchmark yet. Or benchmark for Laguna S 2.1 or Meituan models or lots of other models.
What does the benchmark even mean when people are using AI to make real world things that solve real world problems?
I see people, and my self making amazing things with AI and fixing old projects and having real world impact at the fraction of the cost it would take me to hire people, or hours spent on my own coding.
I have built tools and systems with AI that have allowed me to build windows drivers, android apps, web apps, iOS apps, vm occultation, custom block drivers, custom file systems and more. To the point where entire products have been created.
Not trying to be a doomsday, but yes. It seems as though with the right infrastructure we are at the point where businesses owners can go from idea to product very fast and not need or hire much external talent.
> they need to see/learn by themselves
The cleanup pay is mighty generous as well.