alt Hacker NewsSo what happens to this world view when AI not only clears the forest of problems we couldn't solve but also in the future discovers more forest with trees bigger than anything we've ever seen before?
Not sure what the point of this argument is. Do we have mathematics for the sake of mathematicians good mental health and career or to solve and discover novel problems? Why should we care if mathematicians can understand proofs if they are correct?
If this is V0.5 of AGI/ASI then by V1 the only system that will be understanding any of this is the AI itself. If AI creates a new field of mathematics month 1, then solutions to new problems in month 2, then another field of mathematics on top of that at month 3 there's no human who will ever keep up with that.
Or the alternative is a flattening of abilities, the AI cannot proceed further than the collective intelligence of humans and in that case this is correct. We'd be in a future where nobody wants to work in a field with an AI dominating it and when AI hits the limit of no useful training data input we'd have this giant gap of nobody know wtf it's done for years and nobody willing to figure it out and advance it.
Ooo here's a dytopian story: - AI gets better at everything humans do - humans stop trying - AI cannot improve anymore than its input data + human support - AI slowly degrades itself (model collapse) for decades, it slowly hallucinates little by little until its hallucinating entire scientific fields losing quality over time - there's a mass population of people in the future who never learned to do anything and now have to relearn and figure out the equivalent of 100k years of AI work in order to prevent its slow degredation while all the systems they've come to rely on start failing around them. The AI has solved every problem but every real solution is saturated with 1000 false ones. - humanity starts from scratch?
I love the idea of an archive of every solution to every problem existing but it's impossible to figure out the correct one. Infinite library like!
Replies
there's a book I read "The Practice Effect" such that technology becomes super advanced based on using something, it gets better and better, but the people regress and become more like a medieval society as they just care that using things improves them.
> Not sure what the point of this argument is. Do we have mathematics for the sake of mathematicians good mental health and career or to solve and discover novel problems? Why should we care if mathematicians can understand proofs if they are correct?
Most modern mathematical problems are sufficiently abstract that their proofs or disproofs have no direct application. There's no problem you can fix or invention you can build based solely on OpenAI's construction, because analytic solutions to the Navier-Stokes equations are not used for practical purposes in fluid dynamics. The problems and their proofs are only interesting to the degree that they help us better understand how the math works.
IIUC the Navier-Stokes proof is understandable by human beings, but if it weren't it would be no more useful than a proof that 3 dimensional florg-complete entry seams have no durdle-nodes.
Pure mathematics (defined by anything without a known application) exists not to "solve problems" in the real world, but by whatever mathematicians find interesting or lacking in current knowledge. Based on the agreed set of rules formed over time that ensure rigor.
It just so happens that even bizarrely esoteric math can later turn out to have some extremely useful and economically valuable applications. And even more useful to have mathematicians available who already understand that specific math.