logoalt Hacker News

bethekidyouwantyesterday at 10:07 PM4 repliesview on HN

How could they possibly included in the previous training run which takes months to complete..


Replies

mswphdyesterday at 10:12 PM

I won't take a side in things, but OpenAI stated the model they used here started training August 28th. Note that "training" here might mean "post-training with RLHF an Astra base model" or something. but training had only started a little over a week earlier.

s900mhzyesterday at 10:12 PM

IMO It’s not about being trained on the data, it’s more like what do the agents have access to during inference? Can they grep customer transcripts/logs?

jazzyjacksontoday at 1:24 AM

Has it not been the usual process to snapshot a model to use for inference while continuing to run the training process? I guess you can’t add to the training corpus once you begin? Just trying to make sense of whether training begins or ends as rigidly as you suggest.

metanonsenseyesterday at 10:13 PM

Maybe the boundaries of the memory subsystem are a bit fuzzy.