I will test it when it's accessible via OpenRouter, but the previous LFM2 model (lfm-2-24b-a2b) didn't do well on my tests, it got only 1/20 questions/tasks right, way below Gemma 31B or Qwen 35b-a3b (those get like 10/20 right)
I tested it against Gemma 4 31B and it's expectedly not favorable for world knowledge.
But even against E4B it's shaky, which is surprising given how many tokens they trained on. I guess it was on a lot of synthetic data.
I tested it against Gemma 4 31B and it's expectedly not favorable for world knowledge.
But even against E4B it's shaky, which is surprising given how many tokens they trained on. I guess it was on a lot of synthetic data.