> how LLMs can develop new previously unseen biases for demographic groups, even when there are no differences between groups in the first place!
In real life there ARE differences between groups, and models are trained on real life data, so I do not find surprising that models anticipate differences in this synthetic situation as well, and fail to see the significance of this result.