"It will never be small and never be cheap."

Will your comment age well? We'll see.

We might all be surprised if (somehow, ternary logic?) models come down drastically in size. It doesn't have to be the hardware getting more dense.