alt Hacker NewsThe thread you're in broke away from the main discussion topic.
Again: Nobody is using LLMs to (for example) sort fruit. But there are some industrial processes that prioritize latency over reliability.
The thread you're in broke away from the main discussion topic.
Again: Nobody is using LLMs to (for example) sort fruit. But there are some industrial processes that prioritize latency over reliability.
No, we are literally trying to find a use case where using a lower accuracy LLM makes sense for a vision task.
But fine - what are these industrial processes where that prioritize latency over reliability and using a LLM - as mentioned by the OP - makes sense?