logoalt Hacker News

docheinestagesyesterday at 9:31 AM2 repliesview on HN

Labs are focusing on creating models, small or large, that perform well on various benchmarks, including general knowledge, domain-specific expertise, and agentic capabilities.

Asking for such a model while wanting to be small and fast would align with what you're describing, which I believe is different from what I'm pointing to.

The model I'm describing sacrifices domain knowledge and expertise for agentic reasoning and tool-calling capabilities at a reasonable speed.

Think of Cactus Compute's Needle [1].

[1] https://cactuscompute.com/blog/needle


Replies

tossandthrowyesterday at 5:47 PM

The core intuition here is probably that you can not separate reasoning and domain knowledge.

How are you going to use tools, if you don't have the context to use them?

Imaging if you could only think in terms of lambda calculus, and was asked to check the weather to let me know if the weekend is good for a hike.

show 1 reply