alt Hacker NewsWhy the restriction to safetensors and GGUF? onnx is the more common format and specifically made for interchange.
Replies
satuke • yesterday at 3:05 PM
removed
Why the restriction to safetensors and GGUF? onnx is the more common format and specifically made for interchange.
removed
Does anybody use ONNX for LLMs? I've only encountered it for small models packaged to run on consumer devices, and never seen it show up in any workstation or datacenter scenario.