arxivcs.CLcs.LG2026-06-25
EntMTP: Accelerating LLM Inference with Entropy Guided Multi Token Prediction
Multi-token prediction has been shown to increase data density during training, improve downstream text-generation quality, and serves as the defacto approach for self-speculative decoding. Existing foundation and open source models that use MTP heads commit to a static tree-base…