And then there be large amounts of fake data for the next generation of AIs to learn from.

What is stopping anyone from faking the data they use in their research papers?

Sure it might be verifiable but if the data was made to give the desired results, i.e. faked to be what is required for the paper.