logoalt Hacker News

kooi • yesterday at 11:11 PM • 1 reply • view on HN

Goodness, someone posts a great article which IMO accessible math, and people get upset.

If you think that is crazy, ohh boy, just wait til you see all the other papers underlying LLMs, AI, and optimization in general.

I appreciate this post because starting from linear algebra is the correct way to form an intuition of the higher dimensional semantic spaces we're dealing with.


Replies

D-Machine • today at 3:43 PM

Yeah, the notation and math concepts also all just first-year calculus (or analysis, more accurately) and stats (and the latter being only E for expectation). Literally just summation notation, blackboard bold R for the real numbers, double bars for norm / distance, and then max/min with subscript for the quantity being minimized.

Embarrassing to complain about notation so simple, and, frankly, if you can't understand math concepts and notation this basic, you simply can't meaningfully understand modern neural networks: without the math, all you are doing is substituting loose analogies and metaphor for understanding. This is clearly an article for people that want more than that.