logoalt Hacker News

silentbob7today at 5:30 AM1 replyview on HN

I'm quite impressed by the results of the web demo, especially given its size and the precision with which it uses the three available tools (tested with German commands). I could imagine that this LLM would fit well into a setup with multiple micro-sized LLMs for different purposes; so 14 MB for precise tool invocation is a reasonable memory footprint when a number of other local models are running (e.g. STT, TTS + language models).


Replies

HenryNdubuakutoday at 9:43 AM

yes, that's what we had in mind while building