Loading the model crashes my browser tab from memory usage :/
Yeah, I think you need at least 8gb ram unfortunately, but I tested it only on a 32gb M2, so 8gb might also not be enough.
I might create a compressed version of the model, that would work on low-ram machines.
alt Hacker News
Yeah, I think you need at least 8gb ram unfortunately, but I tested it only on a 32gb M2, so 8gb might also not be enough.
I might create a compressed version of the model, that would work on low-ram machines.