Hi again :) I updated the engine and 27B model should work in the demo[1]. We can still consider it as experimental but I am trying to make it better and efficient.

1. https://stfurkan.github.io/bitgpu/examples/chat.html