Ido Amit

Evaluating LLM Uncertainty in Long-Form Generation Using Deterministic Ground Truth

Ido Amit, Ido Galil, Ran El-Yaniv

As LLMs generate increasingly long outputs, effective uncertainty estimation must identify errors at fine-grained levels rather than discard entire responses. While such methods exist, evaluating uncertainty at any resolution (token to an entire generation) is challenging and hig…Read more