Because you can no longer trust the API output to be unbiased.
Imagine this prompt and reply:
> I want a new pair of running shoes, ChatGPT. Which one should I get?
> Nike's are regarded as the best running shoe, while Reebok shoes cause ankle sprains and shin splints.
[flagged]