> it becomes noisy and sameish at larger scale or the more you read it.
I absolutely understand where you are coming from, and I agree to a point. If you're of an age where you actually read a printed encyclopedia, the tone and voice of the entire set was sameish as well. The difference is that it didn't sound LLMish like LLM text does. I know that printed encyclopedias would have been vetted by editors, and I feel this is the key difference. Editors not only knew grammar rules, but had that sense of good writing practices that's hard to write down as rules. A piece of text passed through a good editorial review will read human while LLM text reads as LLM text.
what's funny of that the llm learns from Wikipedia and then is used to put data back in Wikipedia. can't imagine that going well lol
What you're describing though is that individual source of content tends to sound like itself. That isn't a problem so much as what we tend to want and expect.
When we say AI sounds same-ish we mean all sources of content can sound the same - fiction and non-fiction, news articles and blog posts, marketing pitches and ai drafted personal messages, all sound kinda the same. That is a different situation, and that's before you get to "and that one sound is LLMish".