logoalt Hacker News

OutOfHeretoday at 7:41 AM3 repliesview on HN

Will this run on CPU? (as opposed to GPU)


Replies

vessenestoday at 3:07 PM

I could not get my Mac to successfully do anything with the script from their GitHub; set device to mps, downloaded llama for the first time in a year, and it just .. hangs. I presume this is sortable, but I'm not sure I care enough.

All that said, I think it likely this has been built and trained only on Nvidia

microtheriontoday at 12:08 PM

This is bound to be a question that will be increasingly harder to answer. For instance, Apple processors have at least two different neural accelerators/matrix coprocessors (ANE and AMX) in addition to the integrated GPU. Do these count as "CPU"?

show 1 reply
boxedtoday at 8:39 AM

Why would you want to? It's like using a hammer for screws.

show 2 replies