logoalt Hacker News

sghiassytoday at 2:21 AM2 repliesview on HN

A next-word-in-the-sentence prediction engine can’t predict the factor of two insanely large prime numbers… tell me more


Replies

OJFordtoday at 2:33 AM

I think the thing most of us missed in dismissing GPT 2-3 as 'next word in sentence predictors' was that recursively this allows something resembling thinking, 'reasoning'.

LLMs are capable not just of calculating the most likely next word from a prompt according to a corpus of training text, but of doing so & feeding back into themselves, the most likely word now based not only on the corpus but on the basic prediction, a second (nth) stage of thought.

Yes it's all still token prediction, but it's predicting conversation between let's say not experts but capable speakers with all the information at hand. Undergraduates if you like. And such conversation can yield real results.

show 1 reply
dadriantoday at 2:23 AM

RSA is asymmetric crypto. This article is about symmetric cryptography. I expect LLMs will advance state of the art in factoring algorithms, considerably.

show 3 replies