Léo Bijar

On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain

Atsuki Yamaguchi, Szymon Palucha, Léo Bijar, Aline Villavicencio, Nikolaos Aletras

Mixture-of-Experts (MoE) models offer inference speedups via selective activation but impose substantial memory requirements because the whole network must remain loaded. Structured expert pruning is a practical approach for reducing deployment costs in resource-constrained setti…Read more