Doesn’t RoPE use 2D rotation matrices ?
congrats you've found literally the only example ("the exception that proves the rule").
congrats you've found literally the only example ("the exception that proves the rule").