logoalt Hacker News

mikepapadim • yesterday at 3:52 PM • 0 replies • view on HN

https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java