Finetune and infer: One instance ModernBERT didn't have the learning capacity for a single problem in the shape of my subjective preference task with finetuning, do you not have the basic research taste to realize no conceivable post-training recipe will result in an instance that can zero-shot hundred plus similar questions that vary with each sample?!

You really need to try that to find out?

And again have you actually tried Jev? It has a ton of world knowledge: it's able to infer user personas based on TV show watch histories using fairly recent titles... where the hell do you think that capability is emerging in 395M params?

The irony is if you really want to die on this hill, there are much better angles by focusing on LLMs that've had diffusion heads attached for fast inference with as much of a constrained decoding intelligence penalty: at least that'd put you in the ballpark.

I was being charitable that you know the field and are clueless about Jev, mea culpa for giving you the space to think I'm the one that's missing something.