Keisuke Watanabe

Language Models Agree With Each Other, Not With Readers

Kazuki Nakayashiki, Keisuke Watanabe

Claims that language models homogenise are usually measured against human judgements collected for the study, which makes the human side an artifact of the design: a crowdworker given the model's instruction is running the model's prompt. We measure convergence against a human re…Read more