logoalt Hacker News

wtallis • yesterday at 9:42 PM • 0 replies • view on HN

Does anybody use ONNX for LLMs? I've only encountered it for small models packaged to run on consumer devices, and never seen it show up in any workstation or datacenter scenario.