arxivcs.LG2026-07-09
Resample or Reroute? Budget-Aware Test-Time Model Selection for Large Language Models
Routing among large language models (LLMs) trades response quality against serving cost, motivated by the reported gap between deployed routers and a per-instance oracle. Recent analysis shows that test-time resampling can recover per-instance selection headroom that no single-co…