There's only three kinds of optimization realizations

1) Realize that your problem isn't as general as it was

2) Realize that your problem has a better memory model

3) Realize that your problem can be parallelized further

Hyperoptimizing usually falsely leans on 1