logoalt Hacker News

andsoitis • today at 10:21 AM • 1 reply • view on HN

A hosted instance serves multiple customers at a time. A local model only one.

Replies

toasty228 • today at 11:58 AM

How many though? At 1m context you quickly fill a full gb300's 280gb of memory