Brian Verkhovsky

RoPoLL: Robust Panel of LLM Judges

Anish Acharya, Kris W Pan, Brian Verkhovsky

The LLM Jury, a Panel of LLM Evaluators (PoLL) reporting consensus scores, has become a practical alternative to single-judge LLM evaluation, yet its statistical behavior remains poorly understood. We formalize the LLM Jury under the Huber contamination model and show that PoLL i…Read more