alt Hacker NewsThe point is, the big improvements we’re seeing nowadays are coming from RL, not from scraping the internet.
Replies
ljlolel • yesterday at 10:20 PM
the point isn’t scraping it’s taking your data and enterprises data
https://trustedrouter.com/blog/they-are-still-training-on-yo...
Where are you getting your information from? From all I've seen the RL gives an incremental improvement, most of the capability increase comes from new model architectures (eg the jump from opus to fable is greater than the jump from opus 4.5 to 4.8)