Can't all proofs be eventually broken down into their fundamental pieces and then it's clear as day if it's right or wrong? Seems like a proof would be the best place to determine if an AI is right or not because the output is either right or wrong, there's no subjectivity and the, now common, excuse "well a human would have done the same" won't hold up.
Generally, yes, but once broken down you end up with a large number of items that individually each is obviously true, so you know the combined statement Is true, but you don't find out if it is saying what you think it is saying.
In combining the parts you have the correct answer to a question, but is it that question you want to know?
Consider a proof that in the future all people will be happy.
You can methodically show this to be true but at the same time inadvertently include a proof that the number of people in the future will be zero.
It doesn't make the claim wrong, it stays undoubtedly true. It's just not what you assume it means.
The proof that there are 26 of these sporadic simple groups is part of the theorem known as the classification of finite simple groups, sometimes known as the “Enormous Theorem”.[1] It took over 100 mathematicians nearly 50 years and resulted in hundreds of papers. Even with that many mathematicians involved, there were still errors and revisions needed to the original proof. Some of the original authors are gradually publishing a somewhat simplified version of the proof but it’s still a massive effort.
[1] https://en.wikipedia.org/wiki/Classification_of_finite_simpl...