logoalt Hacker News

kzrdudeyesterday at 6:18 PM1 replyview on HN

I'm unnerved by how alphazero is more complicated than the "intelligent llms"; it has at least multiple heads and MCTS, a search algorithm. The LLMs seem to just be monolithic (if complicated) architectures where tokens go in the bottom and tokens are spit out at the top.


Replies

htrpyesterday at 8:00 PM

imagine what would happen if you gave it MCTS and the data that LLMs were trained on