Since when? Google recently disobeyed some legal requirements because "haha, couldn't catch me / too late now bitch". (This is when they cut down a forest for a datacenter)
Internet data is only good for some parts of model training. That is why there is now a huge cottage industry that creates custom datasets, RL envs, etc.
Incidentally, Google is often considered to be extremely good at pretraining, which is just the thing internet data is good for.
Internet data is only good for some parts of model training. That is why there is now a huge cottage industry that creates custom datasets, RL envs, etc.
Incidentally, Google is often considered to be extremely good at pretraining, which is just the thing internet data is good for.