logoalt Hacker News

woahlast Friday at 9:28 PM1 replyview on HN

My intuition is that since AI assistants are fictional characters in a story being autocompleted by an LLM, mechanisms that are interpretable as human interactions with language and appear in the pretraining data have a surprising advantage over mechanisms that are more like speculation about how the brain works or abstract concepts.


Replies

reactordevlast Friday at 9:33 PM

This is also why LLMs get 80% of the way there and crap out on logic. They were trained on all the open source abandonware on GitHub.