What does the number before the B signify?
Its number of parameters. The 'B' is billions. If you have bf16 weights each parameter would be 16 bits.
alt Hacker News
Its number of parameters. The 'B' is billions. If you have bf16 weights each parameter would be 16 bits.