logoalt Hacker News

Shaanveer • today at 5:42 AM • 1 reply • view on HN

sorry but given how post-training actually works, there's essentially no direct way in which literal PII-scrubbed data made its way into a production oai datamix for RL warmup purposes in 2026 to the extent this data has influence, it's indirect/at the level of process decisions. what i am trying to say more specifically is, the folk model some people seem to still have about ai companies "directly training on user transcripts" in this naive fashion is firstly wrong, and secondarily, would be counterproductive as a strategy for continued progress "transcript shows human trying to do an exotic thing evals don't currently cover -> build synth constructions that broadly cover its genre of problem class -> RL on the verifier set designed to cover the failure" that's the loop... the """flywheel""" is... diagnostics! wow! and so this kind of process improvement driven use of data has an obvious diffuse causal influence on what happens during training, right? but ~none of that process influence looks like "specific mathematician's specific intuitions leak into the training data".


Replies

grey-area • today at 7:16 AM

It’s perfectly plausible that unscrupulous people at OpenAI (and that’s the culture right from the top) searched user transcripts for relevant approaches to problems they were working on, or searched them for problems to look at, and nudged models based on that.

I agree it’s unlikely this happened by accident, or entered training data (though not impossible), but it could certainly be within the context agents were using when tackling problems.

We have no evidence either way, but they had all the data they would need to do this.