alt Hacker NewsAnd this is why I think companies will wise up and stop sending their information to the likes of Anthropic and OpenAI: they will not be able to maintain their edge if either one of them decides to defect and start using all of their uploaded user data to improve the model. So they have a massive incentive to break their own TOS.
Replies
user43928 • yesterday at 9:27 PM
The idea that noisy usage data is worth that much for training as to balance the fatal risk of the crime you describe, imo borders on a conspiracy theory.
I am under the impression that curated training pipelines are driving the gains, not utilizing random usage data in nefarious ways.
That's the push factor. The pull is, say there's a giant repo like windows or Adobe. LLMs produce spaghetti code because the repo doesnt fit in the context and it wasn't in the training set. If Adobe fine tuned it the LLM would be much more useful.