alt Hacker NewsSince NVIDIA owns huggingface now and huggingface has the excellent Candle [1] crate for inference on Rust, this seems like a good step towards nice native Rust kernels.
Replies
jacobgorm • yesterday at 10:56 PM
Nobody cares if kernels are written in Rust. Kernels were meant to be written in C, but if you want to go more high-level try Triton or a similar DSL that nicely abstract tile sizes etc.
➕ show 5 replies
noob here - what's the benefit of this? Will using Rust lead to more optimal LLMs or code or both?