Because usually they achieve a very good middle ground, they are useful for when autovectorization isn't good enough, and it is possible to give a little help to the compiler.

There are many ways that performance matters without trying to win a F1 race.

Go isn't alone, .NET, Java have similar portable libraries, and C++ is in the process of getting one.