Florinel-Alin Croitoru

Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation

Cemil-Andrei Dilmac, Florinel-Alin Croitoru, Radu Tudor Ionescu

Coreset selection aims to identify a small and highly representative subset of a massive dataset for efficient model training. The problem remains challenging even in the few-shot knowledge distillation (KD) setup, where a full-scale pre-trained teacher informs the student networ…Read more