Ido Galil

2 papers indexed

arxivcs.AI2026-07-05

Nemotron-Labs-3-Puzzle-75B-A9B: Compressing Hybrid MoE LLMs

Akhiad Bercovich, Talor Abramovich, Daniel Afrimi, Shay Aharon, Nir Ailon, Vladimir Anisimov, et al.

We present Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super optimized for interactive deployment. We designed the model to maximize server throughput under high user throughput constraints. In interactive serving workloads on a single 8xB200 node, Puzzle-7…

View free PDFSource page

arxivcs.AIcs.CLcs.LG2026-07-04

Evaluating LLM Uncertainty in Long-Form Generation Using Deterministic Ground Truth

Ido Amit, Ido Galil, Ran El-Yaniv

As LLMs generate increasingly long outputs, effective uncertainty estimation must identify errors at fine-grained levels rather than discard entire responses. While such methods exist, evaluating uncertainty at any resolution (token to an entire generation) is challenging and hig…

View free PDFSource page