#Kolibri

4 stories · 1 in 7 days · 1 in 30 days
Stories, products and papers tagged "Kolibri", newest first.
Nov 18
PapersBuildersSelected00:12
No-decay pre-training recipe gains traction across new models

Removing the decay phase turns training length into a flexible decision rather than a fixed plan, which matters for labs managing compute budgets mid-run. Teams planning large pre-training runs can weigh checkpoint averaging against cosine and WSD schedules using this compact comparison of named labs' choices. It is also a useful reference point when evaluating which labs disclose training details at all.

Official accountSebastian Raschka@rasbtSource
Oct 5
Oct 4
ModelsBuildersSelected16:56
Aleph Alpha's Kolibri: 78B open-weight model built for German

A European lab reaching benchmark parity with Chinese and American open models in a bilingual German-English model suggests small-model training capability has spread well beyond the usual hubs. The Apache 2.0 license makes it directly usable for on-premise deployments, which matters for German public-sector and enterprise buyers with data-sovereignty requirements. Teams comparing open models should weigh its German-language edge against its weaker SWE-Bench Verified result.

Event
kimmonismus@kimmonismusSource
ModelsBuildersSelected02:38
Aleph Alpha releases Kolibri, a 78B open-weight model

Kolibri positions compliance as a design feature rather than a bolt-on, making it a candidate for European deployments where GDPR and AI Act alignment block US models. The Apache 2.0 license allows local hosting and fine-tuning without licensing fees, a practical option for ASEAN enterprises evaluating sovereign-AI alternatives to Mistral. Teams needing German-English bilingual capability gain a purpose-built tokenizer.

TestingCatalog@testingcatalogSource