logoalt Hacker News

Kolibri: A Sovereign Open-Weight Model

477 points • by bastitx • today at 9:36 AM • 292 comments • view on HN

tech report: https://aleph-alpha.com/downloads/tech-report.pdf

additional paper: https://tej.as/blog/aleph-alpha-kolibri


Comments

Lucasoato • today at 1:28 PM

> 4. It thinks in German

This means that it’s always on time, it uses acronyms for everything and when there’s a decision to be made, it sets up a committee.

➕ show 11 replies
tfburns • today at 5:37 PM

[flagged]

➕ show 1 reply
derin-picment • today at 8:47 PM

Skimmed the first sections — the most interesting part to me isn't just the 78.1B total / 3.46B active MoE numbers, but the data story: 24T tokens with >20% German, including 2T+ German tokens curated/generated themselves.

That explains why they're framing it around sovereign deployment for public administration / aerospace rather than chasing general English benchmarks. The Pareto-frontier claim on throughput vs quality (Figure 1, 8xB200 evals) is also refreshingly honest — serving cost matters a lot for regulated on-prem use.

Would love to see more detail on how the synthetic German data was validated for quality, and how MergeMix data mixing affected German vs English trade-offs. Apache 2.0 open weights is a big plus here.

OmerKaraaslan • today at 2:33 PM

[flagged]