Also https://github.com/drawthingsai/local-code-community pretty stable around 30 tok/s during decode on 128GiB RAM of M5 (with ~56GiB RAM usage), prefill is around 400 tok/s with 4k chunk.