alt Hacker NewsBut the training data is "predominantly" human written sentences or even interaction. It's like asking you to use non dominant hand to do something. Won't they do better with human sounding english, rather than a made up format text? Are there any literature around this? I was also skeptical of this caveman extension etc.. Won't they work better in their actual language space it's trained on rather than made up language?
Everything it spills out is made up language. Forcing it to respond as what it is (a tool) would mean wasting less tokens but also would be a much tougher sell to people who think AI means it can actually think. This is all just marketing.