Yep. These small models are actually worse than GPT 3.5 at some tasks (like recalling facts). You can definitely make models smarter at specific tasks (like tool calling, coding) but you can't compress the entire human knowledge into a 30GB file. It's just not enough bits.
that is why we enable web search for the agent. the memory can come from the internet.
deepseek-v4-flash needs web search to return true facts.
But why would you use a model to store factual knowledge, that is stupid. We want intelligence, not a database.