Have you tried asking jev to predict the result of a con flip? My one and only prompt to jev so far has been that. After I 90% heads as a result, I figured I'd wait a bit before checking again to see if this tech has become useful
Try it yourself to prove you’re useful. Predict my coin flip.
A probabilistic system that cannot reliably reproduce probabilities - somewhat ironic, but absolutely not its purpose.
That's like not using an LLM for coding assistance because it can't count r's in strawberry.
Try asking it to write a program to predict coin flips. That's what it is trained to do.
I'm dying to know if you got heads or tails when you flipped the coin.
You'll get 50% prediction accuracy for a fair coin no matter what result a model gives. Try testing adversarial games. Mixed strategies make actual sense in them.