alt Hacker NewsRight now there is a stark difference between what smaller models can do and bigger models can do.
Smaller models are suitable for simple tasks like classification / summarisation while larger models are better in agentic capabilities.
Right now there is a stark difference between what smaller models can do and bigger models can do.
Smaller models are suitable for simple tasks like classification / summarisation while larger models are better in agentic capabilities.
Depends on the type of agentic task though. For simple operations, a small model can be quite beneficial.