Alessandro Rinaldo

Prediction-Only Distillation in Linear and Logistic Regression

Hien Dang, Pratik Patil, Alessandro Rinaldo

Self-distillation (SD) is typically studied when the student is retrained on the teacher's original training inputs. In many practical deployments, however, the labeled training data are no longer available, and one has access only to the trained predictor and fresh unlabeled cov…Read more