alt Hacker NewsWell at least it seems pretty implausible to me that a machine learning model trained to reproduce human text can in principle generate something that is significantly above human text production ability. If the "pea-sized semiconductor brain" is not a surprisingly shallow problem that you can just solve by interpolating existing research, I don't really see the LLM-approach to AI being the thing that makes something like it happen.
>we do use simulated evolution as a standard technique in machine learning.
Well, not really. For large-scale AI models it's almost exclusively some form of gradient-based non-linear optimization. Genetic algorithms (which is just hill-climbing optimization with extra steps) and genetic programming (which is really cool and not well-understood) do not perform all that well in practice and I'm not aware of any notable applications.
Replies
Autoregressive pretraining (text/images/video prediction) produces a foundational model. You can look at it as a highly compressed conditional probability distribution of the human brain output. The information-theoretically optimal compression of the data is a program that reproduces functionality of the process that generated the data.
So, it stands to reason (and observations) that such a model captures not only surface statistics of the data, but a part of functionality of the system that generated the data (the human brain for text, physics for video).
> Well at least it seems pretty implausible to me that a machine learning model trained to reproduce human text can in principle generate something that is significantly above human text production ability.
These are not the only currently-in-use AI models. However, recent news has even this particular category of AI solving multiple previously unsolved Erdős problems.
(Even if they also do stupid things on a frequent basis).
> Well, not really. For large-scale AI models it's almost exclusively some form of gradient-based non-linear optimization. Genetic algorithms (which is just hill-climbing optimization with extra steps) and genetic programming (which is really cool and not well-understood) do not perform all that well in practice and I'm not aware of any notable applications.
I said "standard technique" rather than "best" for a reason ;)
This is proof-of-possibility: natural selection did it, we know how to mimic that, but we don't know enough to be sure we're doing it with a reward function that will actually give us minds like ours on an interesting timescale with a probability high enough to care about.