Hand-optimized assembly tends to be ephemeral. My codebase constantly changes, which means hand-written assembly had to be redone.

It's rarely worth the effort.

There a lot of juice in improving the data structures that a compiler cannot do.