Ignacio Boero

Every Sample Counts: Supervised Fine-Tuning of Language Models with Pointwise Constraints

Ignacio Hounie, Ignacio Boero, Alejandro Ribeiro

Fine-tuning language models often requires enforcing constraints on individual inputs without compromising downstream performance. Existing constrained alignment methods impose constraints on average, which can induce undesirable disparities across inputs or users. We propose a n…Read more