logoalt Hacker News

K0balttoday at 2:49 AM2 repliesview on HN

Anyone know how many parameters?


Replies

UnboundedContextoday at 7:19 AM

Approx ~131 million total. Made up of estimated:

102M - modified BERT-base-Chinese text encoder

26M - 3D U-Net-style vision/anatomy encoder

2.8M - projection layers, anatomy-specific projections, query tokens and attention layer

Written to run on something like an H100 though- as the CT Scan data is quite large.

anon373839today at 4:42 AM

The model weights are only ~5GB, so this is small.