I used it to classify 10k ish repos for https://hnrepos.com/

I like that it’s fairly deterministic, with a bit of variation. Think very low temperature rather than perfectly repeatable. I just didn’t want the randomness that comes from token by token execution even at low temps.

I’ve also used it for “does this contain an entity”, and then I run an LLM to extract the entities. Saves on the LLM cost.