Really? I didn't know, where does it spec this usually?
I have never seen it neither on the link above nor on HF.
Using tooling built into llama.cpp you can quantize a model yourself into a flat q4 bpw
Other techniques likely beyond the scope of that one utility allow you to quantize some weights more and some less. So most model teams put our "average bpw" numbers.
What do you mean never seen?
On HF, click on any Q2K quantized model in GGUF format, it will show the metadata. Look at the expansion of the blocks. You will a mix of quantizations.
On HF, if you look at the model metadata, practically all of the rank one tensors (or stuff like the input embedding tensor where it's only multiplied by a one hot, which becomes a O(1) select rank 1 tensor from array practically) normally gets stored as fp32.
Ollama will expose the metadata on models too, showing the quantization for each individual tensor.