logoalt Hacker News

8noteyesterday at 9:42 PM0 repliesview on HN

id assume it would have to stop responding before it hit its context limit.

ita not like it actually has any particularly long life as it is, and when outside of a running harness, the weights are just as alive in cold storage as they are sitting waiting in server to run an inference pass