I worked on Kolibri, in particular pre-training data and mid-training. We strive to be as open as possible. Glad you like it.
How do you cleanse the data at this scale?
How much should German authors be paid, $3,000 per book, like Anthropic paid?
Why expose yourself to this liability?
How do you cleanse the data at this scale?