logoalt Hacker News

lubitelpospat • yesterday at 9:02 PM • 2 replies • view on HN

Surprisingly (or maybe not?), LFM3-VL-2B gave me better results than LFM3-1.7B on text-only prompts (general knowledge, chatting) through liquid playground. As an example, when asked “what does a cow say?”, LFM3-1.7B said that a cow can say “Oink”, and when I asked the same question to LFM3-VL-3B, it (correctly) said “moo”. I assume this is lower quant problem, though: Q8 versions I’ve played with through llama both give the correct “moo” answer.


Replies

samstevens • yesterday at 9:07 PM

quantization is always a problem; what quant were you using?

➕ show 1 reply
taneq • yesterday at 9:16 PM

What do they say if you ask what cows drink? ;) Actually I’d be curious whether they would justify ‘milk’ with ‘when they’re very young’.