It’s optimizing for good writing. Therefore, it believes its outputs are good. Therefore, it believes inputs that look like its outputs are good.
This minus the word "believe". It's explainable simply by marching by similarity
This minus the word "believe". It's explainable simply by marching by similarity