So doing it on a big GPU would be pretty helpful. I wonder if anyone has used CUDA for this, or if any hardware synths have GPUs.
The time it takes to get data to/from the GPU is problematic given the sample rate you need to deliver.
Anukari used the GPU but eventually abandoned it for the CPU. They have some good and informative blog posts about it.
I actually tried doing it as a Vulkan compute shader, continuously simulating 128 strings (all possible MIDI notes). It didn't work very well. While the latency was tolerable, it was slower than doing the same on the CPU (although this was with an integrated GPU, not a dedicated card).