logoalt Hacker News

peddling-brink • yesterday at 3:58 AM • 2 replies • view on HN

> "waves"

OP was postulating that there might be higher order patterns we can see arise out of underlying LLM mechanics.


Replies

HarHarVeryFunny • yesterday at 11:58 AM

Brain waves are due to feedback paths and dynamics - oscillations etc, but LLM connectivity is far simpler. In an LLM there is a strict bottom-up one-way flow of information, with no looping. There is no way for a higher up layer to affect a lower down layer, whether directly or indirectly.

randomImmigrant • yesterday at 4:17 AM

But there is no LLM mechanics. You can certainly take measurements along the neural net and show a wave like pattern of activation. But no such wave can be measured in the hardware. An artificial neuron is really doing nothing to produce physical weave behavior that’s measurable.

➕ show 1 reply