if someone has any tutorial on how to run GLM-5.2 from a Rasberry Pi 5 (AI hat), I want it !
GLM-5.2 is a huge model. I don't think it would fit on the AI HAT+ 2 even if you quantized it to 2 bits
alt Hacker News
GLM-5.2 is a huge model. I don't think it would fit on the AI HAT+ 2 even if you quantized it to 2 bits