alt Hacker NewsMight bother you to use anthropomorphic terminology like smart and learning but they are capable of producing work that traditionally required human intelligence and the whole point of gpt 3 was the ability to "learn", you can give it an example of an invented brand new coding language and it can write working code in that language
Replies
xylenox • yesterday at 4:48 PM
Yep, people always forget that early LLMs were sold as "Zero Shot Learning".
➕ show 1 reply
Context is not the same as learning. It's easy to conflate because they're tightly coupled in our brains.
The underlying structure and tuning of the LLM are entirely unchanged by context. It merely affects the attention and activation of the network. The LLM will not be able to work with this hypothetical new language unless it is in context. This does not fit the computational meaning of learning.
Smart is not a well defined term. Nor is it's general idea formally understood. Use it freely, but you won't be saying anything meaningful unless you define your usage.