> especially base ones
Did you actually try them? I did.They generated even more "slopey" text than instruction-tuned ones.
But was it content indistinguishable from someone learning the language being used, for instance?
But was it content indistinguishable from someone learning the language being used, for instance?