logoalt Hacker News

floatingtorch • today at 1:51 AM • 0 replies • view on HN

There is definitely a system. They are training models of different sizes for different levels of inference efficiency, which maps to token pricing. The ordered set is the size of the weights/ computational complexity during inference.