Yes, they paid for actually using pirated books for their training. They were like the kid, except that it was worth suing them.
At the same time, more broadly, judge in the Anthropic case found that training LLMs was "exceedingly transformative" and “among the most transformative we will see in our lifetimes”
Copyright doesn't protect ideas or let IP owners lock up knowledge, it protects specific expression.