So how do we evaluate how good this is?

Couldn't you hook it up to a multiple choice exam?

It's still LLM like, how smart is it? I'm wary of something that the company states they don't want to benchmark it across public benchmarks.