logoalt Hacker News

mathisfun123yesterday at 7:15 PM7 repliesview on HN

This is like saying being a cashier prepares you for a job in high-finance because both involve arithmetic on dollars and cents.

I've been in ML for ~5 years in multiple FAANGs and I have never seen a rotation matrix.


Replies

bsenftneryesterday at 10:27 PM

A rotation matrix is but one of dozens and dozens of different types of basic transforms. It gets really fun with jacobian 12x12 matrix operations, and free form deformations. Which maps to ML far better than most imagine.

cognoboffinyesterday at 7:45 PM

Doesn’t RoPE use 2D rotation matrices ?

show 1 reply
sreanyesterday at 8:14 PM

... and I have been both situations for longer and have seen tons and tons of them (*)... So?

Not so hypotheticals -- Heck the inputs that you want labelled could be rotation matrices. The desired output could be a rotation matrix. Generating more convenient features could be via a rotation matrix. Dimensionality reduction could be through a reduction matrix. Sparsity could be encouraged by proper use of rotation matrices. Shows up if you want to build in group theoretic invariance in your predictive model.

(*) If you consider Householders then even more

kilpikaarnayesterday at 7:41 PM

I mainly learned linear algebra via hands-on 3D graphics, and have a hard time thinking about a matrix as anything other than 4x4 and representing a linear transform...

How much do you even think about explicit matrix math when doing high-level ML?

show 2 replies
jplusequaltyesterday at 7:28 PM

TBF, I bet any graphics programmer would be a boon for a ML shop for their GPU/performance optimization knowledge alone.

pascahousutyesterday at 7:30 PM

Is the linear algebra of machine learning more complicated than that of graphics?

show 2 replies
rustystumptoday at 3:14 AM

5y multiple fang? Dont you know it is MANGOs now and has been for a while. Are you sure it is FAANGs?