alt Hacker News> you can't even reuse the same architecture for training and inference
AWS begs to differ. They originally split between `Trainium` and `Inferentia` but now support both with `Trainium`
> you can't even reuse the same architecture for training and inference
AWS begs to differ. They originally split between `Trainium` and `Inferentia` but now support both with `Trainium`
I stand corrected, only Google's post-Ironwood TPUs have the split as well.
Nonetheless, TPU architectures are still a systolic array, and have their own limitations for scalability and flexibility. CUDA is no silver bullet, but it satisfies the demands of the edge and research customers very well.