Cheaper/faster is coming for sure.

Model on a custom silicon: https://chatjimmy.ai/

1-bit models that run on a CPU: https://github.com/microsoft/BitNet