alt Hacker NewsAgreed. I don't even know if you, or anyone else, feels joy. Maybe I'm the only person in the world with qualia. I certainly can't prove otherwise.
But with what I know of people and what I know of matrix multiplication, I have a strong suspicion.
Agreed. I don't even know if you, or anyone else, feels joy. Maybe I'm the only person in the world with qualia. I certainly can't prove otherwise.
But with what I know of people and what I know of matrix multiplication, I have a strong suspicion.
I wasn't going solely for "we don't know and we can't know." There are other relevant observations.
A matmul (or a fixed finite sequence of matmuls) is not Turing-complete. An LLM that produces answer in the number of steps that is proportional to the length of the answer is not Turing-complete. An LLM with CoT that produces answer after a number of steps, which is determined by the LLM itself, is Turing-complete.
So, we do have a qualitative step between a matmul and modern LLMs. Of course, it doesn't guaranty having feelings, but it doesn't allow to simply dismiss the notion due to sheer computational inadequacy.