arxivcs.CLcs.AIcs.LG2026-07-10
A Sovereign, Open-Source Foundation Model for German and English
Soofi-Team, :, Benedikt Droste, David Fitzek, Ruben Härle, Lukas Helff, et al.
We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it…