alt Hacker News>Terence Tao is arguing that the human involvement in research is crucial, but doesn't convincingly justify why, in my opinion. He says that "human agency is a value of fundamental importance" and that we will need to build "thriving human communities that can understand [AI ideas] together" - not for the sake of correctness, which AI may surpass us on, but for, I guess, the possibility of reclaiming human meaning and purpose. I don't disagree with this at all, but it's not an argument, it's a statement of values. Unfortunately, the stark reality is that if AI does surpass humans, it will become the economically dominant strategy to not verify them and not double check them, but to just do whatever they say.
I think you have a fundamental misunderstanding here, and it's not really explained because I think it seems self-evident from within the field. In short: writing code is a means to an end; doing mathematics research is not, but is the end in itself.
The human involvement is crucial because the entire purpose of mathematics research is to increase human understanding of mathematics. It is pursued because it is interesting, not because it is economically useful. In this sense it's a lot closer to the humanities.
A black box oracle that just tells you whether statements are true or false is not the goal of mathematics and would not be particularly interesting to the field (except insofar as it could be harnessed to improve human understanding).
Coding is totally different from this, where it is essentially always done as a means to an end. Likewise with many other fields, like pharmaceutical research or materials science or what have you, that are oriented around solving problems for some practical purpose. Pure math isn't really like that for the most part.
Replies
Sure, but I don’t think most of the money that goes into funding math is for the purposes of pure understanding. The reason governments fund mathematics research grants is generally for a more instrumental purpose; taking the US congress as an example, the mission of the NSF is to, “Promote the progress of science; advance national health, prosperity, and welfare; and secure national defense.” Most federal math grants come from the NSF.
Of course, math research is cheap and most academics don’t rely upon grants, their salary covers most of their expenses. But here too, the mathematics professor spends a substantial amount of their time teaching future engineers/quants/other applied mathematicians, who need to understand math for instrumental purposes, not as an end in and of itself. Without the tuitions of these students, I can’t imagine universities maintaining the size of their math departments, let alone expanding them as Dr. Sahai advocates for.
So who or what funds the community of pure mathematics going forward?
Well with AI, programming among humans will become like math. A hobby.
Another day, another HN thread full of programmers who think mathematics is just like programming.
Thanks for providing a (much needed!) correction.
I think you have misunderstood the OP's point here. You're arguing that deepening human understanding is an end in itself, and you are right. The OP is arguing that advances don't need to be pegged to human understanding, and they are right too. The two can coexist, superintelligence far ahead of us, pioneering discoveries - and mathematicians catching up at a pace suited to biological minds. I don't see the issue here. Of course, it does mean mathematicians adopt a new role as hobbyists.
> A black box oracle that just tells you whether statements are true or false is not the goal of mathematics and would not be particularly interesting to the field
This is a crude distortion. The recent breakthroughs have come with proofs, reasoning and verification, and there is no proposal that I'm aware of that would do away with these foundations. There's also some rather ugly solipsism in the idea of keeping what interests the field as a limit. Mathematics has broader relevance to humanity than merely to please and support mathematicians, and if other fields can make practical use of profound well-proven future math, mathematicians will have a hard time making a case that their comprehension must come first.