logoalt Hacker News

satvikpendemtoday at 1:28 AM1 replyview on HN

Apple is releasing CoreAI which is supposed to be optimized for LLMs and the transformer architecture.


Replies

mfrotoday at 1:37 PM

I've done some basic testing of the CoreAI framework (using Apple's official 'llm-runner' and officially supported .coreai converted models) and seen no noticable performance increase between standard MLX or GGUF with llama.cpp. I'd love to see some thorough benchmarks from someone though.