logoalt Hacker News

alansaber • today at 12:38 PM • 0 replies • view on HN

Exactly. I used to think new tokenizers for domain-specific models was the way (makes intuitive sense, better representations etc), but the added overhead of essentially training from scratch made it much more expensive than a FT.