That TPU training part I get, but from what I have seen the NPU is rarely used for inference by LLMs. They still use the GPU, no?