logoalt Hacker News

yobanatetoday at 12:44 PM0 repliesview on HN

It's really easy to test and it's my personal go-to benchmark. I ask the model something deep and unproven, meta physical like "oh, I heard that magic mushrooms can open the mind, but does that mean some of the great ideas people had, famous people were due to that or was the idea already there?" Like, bullshit questions that nudge towards a known example (Steve Jobs in this case) that are hard to answer and then add something like "but I'm mincing my words here, you'll get what I mean". You'll get an interesting interpretation of the question back.

I use better questions than the above but will keep my questions safe so they don't end up in the model, the point is however, when the model repeats your question back to you and "gets" what you really mean, that's a good sign of intuition and also suggests you'll get a response back that hopefully matters.