logoalt Hacker News

lurker137 • today at 7:02 PM • 0 replies • view on HN

My understanding is that LLMs can be used to make small improvements on top the transformer architecture, to make LLMs that are even more intelligent and so are more capable of making more improvements. At some point we might reach the practical limit of intelligence using transformers, and if the LLMs of that time aren't able to make the leap to discover a new architecture, then the improvement stalls. I don't think it will be possible