Aleph Alpha 发布开放权重 MoE 模型 Kolibri,总参数 78B、激活参数 3.46B,上下文最高 1M token,并采用 Apache 2.0 许可。
Aleph Alpha released Kolibri, a 78B-parameter, 3.46B active, MoE open-weight model with 1M context window, distributed under the Apache 2.0 license.
Aleph Alpha is a German AI lab, and it is probably the first general-purpose model from the EU, apart from Mistral, to achieve this level of performance!
> "The model supports an explicit reasoning mode and tool calling. It is optimized for long-context and inference efficiency."
> "The Aleph Alpha team developed a bilingual German/English tokenizer and focused on including organic German data throughout the training process of the model, so that 21.3% of the pre-training tokens are German."
> "Kolibri was built with the EU AI Act, the General-Purpose AI Code of Practice and the GDPR in mind from the ground up, with copyright law being a focus of our work to trustworthy technology."
More EU labs are joining the party 👀
Small bird, fast wings, Kolibri is here. 78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe. Now the weights are yours. Run it on your own hardware, under Apache 2.0.在 X 查看被引用的帖子
来源:🚨 AI News | TestingCatalog · x.com