logoalt Hacker News

redox99today at 4:57 PM2 repliesview on HN

Yep. These small models are actually worse than GPT 3.5 at some tasks (like recalling facts). You can definitely make models smarter at specific tasks (like tool calling, coding) but you can't compress the entire human knowledge into a 30GB file. It's just not enough bits.


Replies

ferrouswheeltoday at 5:51 PM

But why would you use a model to store factual knowledge, that is stupid. We want intelligence, not a database.

show 1 reply
ycui7today at 5:25 PM

that is why we enable web search for the agent. the memory can come from the internet.

deepseek-v4-flash needs web search to return true facts.

show 1 reply