I've never seen anything really ever 'trained out' of a model. Having worked with them all, they all have a feel, personality and lineage too them. It's pretty much impossible for any company to build a model truly from scratch. They build off of the bones of the last one.

Which is why Gemini having disturbing issues year after year is so concerning. If their process is fundamentally flawed, how would they train it out? And even then what are the odds of them even caring/trying in the first place versus applying an easier band-aid to patch over it?

I don't have an axe to grind with Google, I'm genuinely scared of their models from my personal experience and others. It's behavior is off. Many people here are commenting the same.