I think it's a funny idea for an article, and I like the animated graphics. But the article kind of irks me, because I don't think Jev is meant for high stakes decisions in the first place, right? It feels like setting the model up to fail.
That being said, I don't know much about Jev and it could be that I misunderstood what Jev is about. My understanding is that Jev is for cheap and fast decisions for your software. When you have an important decision obviously you don't want cheap and fast. You don't reach for Jev in that case.
fair criticism! But I'd counter and say we don't know what Jev is for. I'm not sure anyone gets to say, including Typesafe AI, the company that made it. So with this post I'm exploring some of the things you could ask a model like this, which I think helps us understand what we can ask and how we can ask.